Aug 01 16:47:39 user nova-compute[72184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 16:47:41 user nova-compute[72184]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72184) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 16:47:41 user nova-compute[72184]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72184) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 16:47:41 user nova-compute[72184]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72184) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 16:47:41 user nova-compute[72184]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 16:47:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:47:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:47:42 user nova-compute[72184]: INFO nova.virt.driver [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 16:47:42 user nova-compute[72184]: INFO nova.compute.provider_config [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Acquiring lock "singleton_lock" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Acquired lock "singleton_lock" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Releasing lock "singleton_lock" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Full set of CONF: {{(pid=72184) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ******************************************************************************** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Configuration options gathered from: {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ================================================================================ {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] allow_resize_to_same_host      = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] arq_binding_timeout            = 300 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] backdoor_port                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] backdoor_socket                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] block_device_allocate_retries  = 300 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] block_device_allocate_retries_interval = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cert                           = self.pem {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute_monitors               = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] config_dir                     = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] config_drive_format            = iso9660 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] config_source                  = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] console_host                   = user {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] control_exchange               = nova {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cpu_allocation_ratio           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] daemon                         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] debug                          = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] default_access_ip_network_name = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] default_availability_zone      = nova {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] default_ephemeral_format       = ext4 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] default_schedule_zone          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] disk_allocation_ratio          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] enable_new_services            = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] enabled_ssl_apis               = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] flat_injected                  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] force_config_drive             = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] force_raw_images               = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] graceful_shutdown_timeout      = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] heal_instance_info_cache_interval = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] host                           = user {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_build_timeout         = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_delete_interval       = 300 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_name_template         = instance-%08x {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_usage_audit           = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_usage_audit_period    = month {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] internal_service_availability_zone = internal {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] key                            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] live_migration_retry_count     = 30 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_config_append              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_dir                        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_file                       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_options                    = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_rotate_interval            = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_rotate_interval_type       = days {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] log_rotation_type              = none {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] long_rpc_timeout               = 1800 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] max_concurrent_builds          = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] max_concurrent_live_migrations = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] max_concurrent_snapshots       = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] max_local_block_devices        = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] max_logfile_count              = 30 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] max_logfile_size_mb            = 200 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] maximum_instance_delete_attempts = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metadata_listen                = 0.0.0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metadata_listen_port           = 8775 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metadata_workers               = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] migrate_max_retries            = -1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] mkisofs_cmd                    = genisoimage {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] my_ip                          = 10.0.0.210 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] network_allocate_retries       = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] osapi_compute_listen_port      = 8774 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] osapi_compute_unique_server_name_scope =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] osapi_compute_workers          = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] password_length                = 12 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] periodic_enable                = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] periodic_fuzzy_delay           = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] pointer_model                  = ps2mouse {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] preallocate_images             = none {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] publish_errors                 = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] pybasedir                      = /opt/stack/nova {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ram_allocation_ratio           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rate_limit_burst               = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rate_limit_except_level        = CRITICAL {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rate_limit_interval            = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reboot_timeout                 = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reclaim_instance_interval      = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] record                         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reimage_timeout_per_gb         = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] report_interval                = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rescue_timeout                 = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reserved_host_cpus             = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reserved_host_disk_mb          = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reserved_host_memory_mb        = 512 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] reserved_huge_pages            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] resize_confirm_window          = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] resize_fs_using_block_device   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] resume_guests_state_on_host_boot = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rpc_response_timeout           = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] run_external_periodic_tasks    = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] running_deleted_instance_action = reap {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] running_deleted_instance_timeout = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler_instance_sync_interval = 120 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_down_time              = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] servicegroup_driver            = db {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] shelved_offload_time           = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] shelved_poll_interval          = 3600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] shutdown_timeout               = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] source_is_ipv6                 = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ssl_only                       = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] state_path                     = /opt/stack/data/nova {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] sync_power_state_interval      = 600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] sync_power_state_pool_size     = 1000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] syslog_log_facility            = LOG_USER {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] tempdir                        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] timeout_nbd                    = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] transport_url                  = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] update_resources_interval      = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_cow_images                 = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_eventlog                   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_journal                    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_json                       = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_rootwrap_daemon            = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_stderr                     = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] use_syslog                     = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vcpu_pin_set                   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plugging_is_fatal          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plugging_timeout           = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] virt_mkfs                      = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] volume_usage_poll_interval     = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] watch_log_file                 = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] web                            = /usr/share/spice-html5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_concurrency.disable_process_locking = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.auth_strategy              = keystone {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.compute_link_prefix        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.dhcp_domain                = novalocal {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.enable_instance_password   = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.glance_link_prefix         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.instance_list_per_project_cells = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.list_records_by_skipping_down_cells = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.local_metadata_per_cell    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.max_limit                  = 1000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.metadata_cache_expiration  = 15 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.neutron_default_tenant_id  = default {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.use_forwarded_for          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.use_neutron_default_nets   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_dynamic_targets = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_jsonfile_path   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.backend_argument         = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.config_prefix            = cache.oslo {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.dead_timeout             = 60.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.debug_cache_backend      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.enable_retry_client      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.enable_socket_keepalive  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.enabled                  = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.expiration_time          = 600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.hashclient_retry_attempts = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_dead_retry      = 300 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_password        =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_sasl_enabled    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.memcache_username        =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.proxies                  = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.retry_attempts           = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.retry_delay              = 0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.socket_keepalive_count   = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.socket_keepalive_idle    = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.socket_keepalive_interval = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.tls_allowed_ciphers      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.tls_cafile               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.tls_certfile             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.tls_enabled              = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cache.tls_keyfile              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.auth_section            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.auth_type               = password {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.cafile                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.certfile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.collect_timing          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.cross_az_attach         = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.debug                   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.endpoint_template       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.http_retries            = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.insecure                = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.keyfile                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.os_region_name          = RegionOne {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.split_loggers           = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cinder.timeout                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.cpu_dedicated_set      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.cpu_shared_set         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.image_type_exclude_list = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.resource_provider_association_refresh = 300 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.shutdown_retry_interval = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] conductor.workers              = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] console.allowed_origins        = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] console.ssl_ciphers            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] console.ssl_minimum_version    = default {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] consoleauth.token_ttl          = 600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.cafile                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.certfile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.collect_timing          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.connect_retries         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.connect_retry_delay     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.endpoint_override       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.insecure                = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.keyfile                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.max_version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.min_version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.region_name             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.service_name            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.service_type            = accelerator {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.split_loggers           = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.status_code_retries     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.timeout                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] cyborg.version                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.backend               = sqlalchemy {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.connection            = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.connection_debug      = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.connection_parameters =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.connection_recycle_time = 3600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.connection_trace      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.db_inc_retry_interval = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.db_max_retries        = 20 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.db_max_retry_interval = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.db_retry_interval     = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.max_overflow          = 50 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.max_pool_size         = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.max_retries           = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.mysql_enable_ndb      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.mysql_wsrep_sync_wait = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.pool_timeout          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.retry_interval        = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.slave_connection      = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] database.sqlite_synchronous    = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.backend           = sqlalchemy {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.connection        = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.connection_debug  = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.connection_parameters =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.connection_recycle_time = 3600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.connection_trace  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.db_inc_retry_interval = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.db_max_retries    = 20 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.db_max_retry_interval = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.db_retry_interval = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.max_overflow      = 50 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.max_pool_size     = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.max_retries       = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.mysql_enable_ndb  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.pool_timeout      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.retry_interval    = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.slave_connection  = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] api_database.sqlite_synchronous = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] devices.enabled_mdev_types     = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ephemeral_storage_encryption.enabled = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.api_servers             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.cafile                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.certfile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.collect_timing          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.connect_retries         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.connect_retry_delay     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.debug                   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.default_trusted_certificate_ids = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.enable_certificate_validation = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.enable_rbd_download     = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.endpoint_override       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.insecure                = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.keyfile                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.max_version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.min_version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.num_retries             = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.rbd_ceph_conf           =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.rbd_connect_timeout     = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.rbd_pool                =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.rbd_user                =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.region_name             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.service_name            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.service_type            = image {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.split_loggers           = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.status_code_retries     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.timeout                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.verify_glance_signatures = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] glance.version                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] guestfs.debug                  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.config_drive_cdrom      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.config_drive_inject_password = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.enable_remotefx         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.instances_path_share    =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.limit_cpu_features      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.use_multipath_io        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.vswitch_name            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] mks.enabled                    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] image_cache.manager_interval   = 2400 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] image_cache.precache_concurrency = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] image_cache.remove_unused_base_images = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] image_cache.subdirectory_name  = _base {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.api_max_retries         = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.api_retry_interval      = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.auth_section            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.auth_type               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.cafile                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.certfile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.collect_timing          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.connect_retries         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.connect_retry_delay     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.endpoint_override       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.insecure                = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.keyfile                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.max_version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.min_version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.partition_key           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.peer_list               = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.region_name             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.serial_console_state_timeout = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.service_name            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.service_type            = baremetal {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.split_loggers           = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.status_code_retries     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.timeout                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ironic.version                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] key_manager.fixed_key          = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.barbican_api_version  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.barbican_endpoint     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.barbican_endpoint_type = public {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.barbican_region_name  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.cafile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.certfile              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.collect_timing        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.insecure              = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.keyfile               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.number_of_retries     = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.retry_delay           = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.send_service_user_token = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.split_loggers         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.timeout               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.verify_ssl            = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican.verify_ssl_path       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.auth_section = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.auth_type = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.cafile   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.certfile = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.collect_timing = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.insecure = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.keyfile  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.split_loggers = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] barbican_service_user.timeout  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.approle_role_id          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.approle_secret_id        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.cafile                   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.certfile                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.collect_timing           = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.insecure                 = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.keyfile                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.kv_mountpoint            = secret {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.kv_version               = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.namespace                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.root_token_id            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.split_loggers            = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.ssl_ca_crt_file          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.timeout                  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.use_ssl                  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.cafile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.certfile              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.collect_timing        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.connect_retries       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.connect_retry_delay   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.endpoint_override     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.insecure              = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.keyfile               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.max_version           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.min_version           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.region_name           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.service_name          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.service_type          = identity {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.split_loggers         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.status_code_retries   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.timeout               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] keystone.version               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.connection_uri         =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_mode               = custom {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: WARNING oslo_config.cfg [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_power_governor_high = performance {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_power_management   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.device_detach_attempts = 8 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.device_detach_timeout  = 20 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.disk_cachemodes        = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.disk_prefix            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.enabled_perf_events    = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.file_backed_memory     = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.gid_maps               = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.hw_disk_discard        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.hw_machine_type        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_rbd_pool        = rbd {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_type            = default {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.images_volume_group    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.inject_key             = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.inject_partition       = -2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.inject_password        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.iscsi_iface            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.iser_use_multipath     = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_downtime = 500 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_inbound_addr = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_scheme  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_timeout_action = abort {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_tunnelled = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: WARNING oslo_config.cfg [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 16:47:42 user nova-compute[72184]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 16:47:42 user nova-compute[72184]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 16:47:42 user nova-compute[72184]: and ``live_migration_inbound_addr`` respectively.
Aug 01 16:47:42 user nova-compute[72184]: ).  Its value may be silently ignored in the future.
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.live_migration_with_native_tls = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.max_queues             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.nfs_mount_options      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.num_pcie_ports         = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.pmem_namespaces        = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.quobyte_client_cfg     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rbd_secret_uuid        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rbd_user               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rescue_image_id        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rescue_kernel_id       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.rx_queue_size          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.smbfs_mount_options    =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.snapshot_compression   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.snapshot_image_format  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.sparse_logical_volumes = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.swtpm_enabled          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.swtpm_group            = tss {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.swtpm_user             = tss {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.sysinfo_serial         = unique {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.tb_cache_size          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.tx_queue_size          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.uid_maps               = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.use_virtio_for_bridges = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.virt_type              = kvm {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.volume_clear           = zero {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.volume_clear_size      = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.volume_use_multipath   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_cache_path   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.auth_section           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.auth_type              = password {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.cafile                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.certfile               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.collect_timing         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.connect_retries        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.connect_retry_delay    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.default_floating_pool  = public {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.endpoint_override      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.extension_sync_interval = 600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.http_retries           = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.insecure               = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.keyfile                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.max_version            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.min_version            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.ovs_bridge             = br-int {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.physnets               = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.region_name            = RegionOne {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.service_metadata_proxy = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.service_name           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.service_type           = network {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.split_loggers          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.status_code_retries    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.timeout                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] neutron.version                = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] notifications.bdms_in_notifications = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] notifications.default_level    = INFO {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] notifications.notification_format = unversioned {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] notifications.notify_on_state_change = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] pci.alias                      = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] pci.device_spec                = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] pci.report_in_placement        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.auth_section         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.auth_type            = password {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.cafile               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.certfile             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.collect_timing       = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.connect_retries      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.connect_retry_delay  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.default_domain_id    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.default_domain_name  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.domain_id            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.domain_name          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.endpoint_override    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.insecure             = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.keyfile              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.max_version          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.min_version          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.password             = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.project_domain_id    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.project_domain_name  = Default {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.project_id           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.project_name         = service {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.region_name          = RegionOne {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.service_name         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.service_type         = placement {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.split_loggers        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.status_code_retries  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.system_scope         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.timeout              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.trust_id             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.user_domain_id       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.user_domain_name     = Default {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.user_id              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.username             = placement {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] placement.version              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.cores                    = 20 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.count_usage_from_placement = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.injected_file_content_bytes = 10240 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.injected_file_path_length = 255 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.injected_files           = 5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.instances                = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.key_pairs                = 100 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.metadata_items           = 128 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.ram                      = 51200 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.recheck_quota            = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.server_group_members     = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] quota.server_groups            = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rdp.enabled                    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.image_metadata_prefilter = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.max_attempts         = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.max_placement_results = 1000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] scheduler.workers              = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.host_subset_size = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.isolated_hosts = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.isolated_images = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.pci_in_placement = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.track_instance_changes = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metrics.required               = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metrics.weight_multiplier      = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] metrics.weight_setting         = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] serial_console.enabled         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] serial_console.port_range      = 10000:20000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] serial_console.serialproxy_port = 6083 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.auth_section      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.auth_type         = password {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.cafile            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.certfile          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.collect_timing    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.insecure          = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.keyfile           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.send_service_user_token = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.split_loggers     = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] service_user.timeout           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.agent_enabled            = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.enabled                  = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.html5proxy_port          = 6082 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.image_compression        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.jpeg_compression         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.playback_compression     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.server_listen            = 127.0.0.1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.streaming_mode           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] spice.zlib_compression         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] upgrade_levels.baseapi         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] upgrade_levels.cert            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] upgrade_levels.compute         = auto {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] upgrade_levels.conductor       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] upgrade_levels.scheduler       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.cafile = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.certfile = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.insecure = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vendordata_dynamic_auth.timeout = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.api_retry_count         = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.ca_file                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.cache_prefix            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.cluster_name            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.connection_pool_size    = 10 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.console_delay_seconds   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.datastore_regex         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.host_ip                 = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.host_password           = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.host_port               = 443 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.host_username           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.insecure                = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.integration_bridge      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.maximum_objects         = 100 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.pbm_default_policy      = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.pbm_enabled             = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.pbm_wsdl_location       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.serial_port_proxy_uri   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.serial_port_service_uri = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.task_poll_interval      = 0.5 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.use_linked_clone        = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.vnc_keymap              = en-us {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.vnc_port                = 5900 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vmware.vnc_port_total          = 10000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.auth_schemes               = ['none'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.enabled                    = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.novncproxy_port            = 6080 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.vencrypt_ca_certs          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.vencrypt_client_cert       = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vnc.vencrypt_client_key        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.disable_rootwrap   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.enable_numa_live_migration = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.libvirt_disable_apic = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.client_socket_timeout     = 900 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.default_pool_size         = 1000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.keep_alive                = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.max_header_line           = 16384 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.ssl_ca_file               = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.ssl_cert_file             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.ssl_key_file              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.tcp_keepidle              = 600 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] zvm.ca_file                    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] zvm.cloud_connector_url        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] zvm.reachable_timeout          = 300 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.enforce_new_defaults = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.enforce_scope      = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.policy_default_rule = default {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.connection_string     = messaging:// {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.enabled               = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.es_doc_type           = notification {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.es_scroll_size        = 10000 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.es_scroll_time        = 2m {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.filter_error_trace    = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.hmac_keys             = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.sentinel_service_name = mymaster {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.socket_timeout        = 0.1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.trace_requests        = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler.trace_sqlalchemy      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler_jaeger.process_tags   = {} {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler_jaeger.service_name_prefix = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] profiler_otlp.service_name_prefix = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] remote_debug.host              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] remote_debug.port              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_notifications.retry = -1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.auth_section        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.auth_type           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.cafile              = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.certfile            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.collect_timing      = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.connect_retries     = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.connect_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.endpoint_id         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.endpoint_override   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.insecure            = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.keyfile             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.max_version         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.min_version         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.region_name         = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.service_name        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.service_type        = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.split_loggers       = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.status_code_retries = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.status_code_retry_delay = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.timeout             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.valid_interfaces    = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_limit.version             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_reports.file_event_handler = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] oslo_reports.log_dir           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_ovs_privileged.group  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] vif_plug_ovs_privileged.user   = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_ovs.isolate_vif         = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] os_brick.lock_path             = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] privsep_osbrick.capabilities   = [21] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] privsep_osbrick.group          = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] privsep_osbrick.helper_command = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] privsep_osbrick.user           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] nova_sys_admin.group           = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] nova_sys_admin.helper_command  = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] nova_sys_admin.user            = None {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG oslo_service.service [None req-fc2d9601-10b4-4f6d-940d-60868a301109 None None] ******************************************************************************** {{(pid=72184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 16:47:42 user nova-compute[72184]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Starting native event thread {{(pid=72184) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Starting green dispatch thread {{(pid=72184) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Starting connection event dispatch thread {{(pid=72184) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Connecting to libvirt: qemu:///system {{(pid=72184) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f301f7f4a00> {{(pid=72184) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f301f7f4a00> {{(pid=72184) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 16:47:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Connection event '1' reason 'None'
Aug 01 16:47:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 16:47:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.mount [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Initialising _HostMountState generation 0 {{(pid=72184) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 16:47:49 user nova-compute[72184]: INFO nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host capabilities <capabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <host>
Aug 01 16:47:49 user nova-compute[72184]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 16:47:49 user nova-compute[72184]:     <cpu>
Aug 01 16:47:49 user nova-compute[72184]:       <arch>x86_64</arch>
Aug 01 16:47:49 user nova-compute[72184]:       <model>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <microcode version='1070'/>
Aug 01 16:47:49 user nova-compute[72184]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='osxsave'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='invtsc'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='rsba'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 16:47:49 user nova-compute[72184]:       <pages unit='KiB' size='4'/>
Aug 01 16:47:49 user nova-compute[72184]:       <pages unit='KiB' size='2048'/>
Aug 01 16:47:49 user nova-compute[72184]:     </cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <power_management>
Aug 01 16:47:49 user nova-compute[72184]:       <suspend_mem/>
Aug 01 16:47:49 user nova-compute[72184]:       <suspend_disk/>
Aug 01 16:47:49 user nova-compute[72184]:       <suspend_hybrid/>
Aug 01 16:47:49 user nova-compute[72184]:     </power_management>
Aug 01 16:47:49 user nova-compute[72184]:     <iommu support='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <migration_features>
Aug 01 16:47:49 user nova-compute[72184]:       <live/>
Aug 01 16:47:49 user nova-compute[72184]:       <uri_transports>
Aug 01 16:47:49 user nova-compute[72184]:         <uri_transport>tcp</uri_transport>
Aug 01 16:47:49 user nova-compute[72184]:         <uri_transport>rdma</uri_transport>
Aug 01 16:47:49 user nova-compute[72184]:       </uri_transports>
Aug 01 16:47:49 user nova-compute[72184]:     </migration_features>
Aug 01 16:47:49 user nova-compute[72184]:     <topology>
Aug 01 16:47:49 user nova-compute[72184]:       <cells num='2'>
Aug 01 16:47:49 user nova-compute[72184]:         <cell id='0'>
Aug 01 16:47:49 user nova-compute[72184]:           <memory unit='KiB'>8140616</memory>
Aug 01 16:47:49 user nova-compute[72184]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 01 16:47:49 user nova-compute[72184]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 16:47:49 user nova-compute[72184]:           <distances>
Aug 01 16:47:49 user nova-compute[72184]:             <sibling id='0' value='10'/>
Aug 01 16:47:49 user nova-compute[72184]:             <sibling id='1' value='20'/>
Aug 01 16:47:49 user nova-compute[72184]:           </distances>
Aug 01 16:47:49 user nova-compute[72184]:           <cpus num='6'>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 16:47:49 user nova-compute[72184]:           </cpus>
Aug 01 16:47:49 user nova-compute[72184]:         </cell>
Aug 01 16:47:49 user nova-compute[72184]:         <cell id='1'>
Aug 01 16:47:49 user nova-compute[72184]:           <memory unit='KiB'>8255068</memory>
Aug 01 16:47:49 user nova-compute[72184]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 01 16:47:49 user nova-compute[72184]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 16:47:49 user nova-compute[72184]:           <distances>
Aug 01 16:47:49 user nova-compute[72184]:             <sibling id='0' value='20'/>
Aug 01 16:47:49 user nova-compute[72184]:             <sibling id='1' value='10'/>
Aug 01 16:47:49 user nova-compute[72184]:           </distances>
Aug 01 16:47:49 user nova-compute[72184]:           <cpus num='6'>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 16:47:49 user nova-compute[72184]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 16:47:49 user nova-compute[72184]:           </cpus>
Aug 01 16:47:49 user nova-compute[72184]:         </cell>
Aug 01 16:47:49 user nova-compute[72184]:       </cells>
Aug 01 16:47:49 user nova-compute[72184]:     </topology>
Aug 01 16:47:49 user nova-compute[72184]:     <cache>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 16:47:49 user nova-compute[72184]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 16:47:49 user nova-compute[72184]:     </cache>
Aug 01 16:47:49 user nova-compute[72184]:     <secmodel>
Aug 01 16:47:49 user nova-compute[72184]:       <model>apparmor</model>
Aug 01 16:47:49 user nova-compute[72184]:       <doi>0</doi>
Aug 01 16:47:49 user nova-compute[72184]:     </secmodel>
Aug 01 16:47:49 user nova-compute[72184]:     <secmodel>
Aug 01 16:47:49 user nova-compute[72184]:       <model>dac</model>
Aug 01 16:47:49 user nova-compute[72184]:       <doi>0</doi>
Aug 01 16:47:49 user nova-compute[72184]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 16:47:49 user nova-compute[72184]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 16:47:49 user nova-compute[72184]:     </secmodel>
Aug 01 16:47:49 user nova-compute[72184]:   </host>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='alpha'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>clipper</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='armv6l'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>spitz</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>nuri</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>kzm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sx1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>z2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>tosa</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>n810</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>n800</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>terrier</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>midway</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>microbit</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>verdex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>highbank</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>akita</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>connex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>collie</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='armv7l'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>spitz</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>nuri</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>kzm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sx1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>z2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>tosa</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>n810</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>n800</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>terrier</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>midway</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>microbit</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>verdex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>highbank</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>akita</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>connex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>collie</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='aarch64'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>spitz</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>nuri</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>kzm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sx1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>z2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>tosa</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>n810</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>n800</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>terrier</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>midway</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>microbit</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>verdex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>highbank</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>akita</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>connex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>collie</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <acpi default='on' toggle='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='cris'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='i686'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>isapc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>microvm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='kvm'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <pae/>
Aug 01 16:47:49 user nova-compute[72184]:       <nonpae/>
Aug 01 16:47:49 user nova-compute[72184]:       <acpi default='on' toggle='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:       <apic default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='m68k'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>an5206</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>q800</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='microblaze'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='microblazeel'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='mips'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='16'>malta</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='mipsel'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='16'>malta</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='mips64'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='16'>malta</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>pica61</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>magnum</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='mips64el'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='16'>malta</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>pica61</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>magnum</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='16'>boston</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='ppc'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mac99</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>40p</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>taihu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='ppc64'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>taihu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>40p</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mac99</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='ppc64le'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>taihu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>40p</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>mac99</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='riscv32'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='8'>spike</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='8'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='riscv64'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='8'>spike</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='8'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='s390x'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='sh4'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>shix</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>r2d</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='sh4eb'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>shix</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>r2d</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='sparc'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>LX</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='sparc64'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>niagara</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='x86_64'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>64</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='1'>isapc</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>microvm</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='kvm'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <acpi default='on' toggle='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:       <apic default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='xtensa'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>sim</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>kc705</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ml605</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx200</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx60</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]:   <guest>
Aug 01 16:47:49 user nova-compute[72184]:     <os_type>hvm</os_type>
Aug 01 16:47:49 user nova-compute[72184]:     <arch name='xtensaeb'>
Aug 01 16:47:49 user nova-compute[72184]:       <wordsize>32</wordsize>
Aug 01 16:47:49 user nova-compute[72184]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='4'>sim</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>kc705</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ml605</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>virt</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx200</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>lx60</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 16:47:49 user nova-compute[72184]:       <domain type='qemu'/>
Aug 01 16:47:49 user nova-compute[72184]:     </arch>
Aug 01 16:47:49 user nova-compute[72184]:     <features>
Aug 01 16:47:49 user nova-compute[72184]:       <cpuselection/>
Aug 01 16:47:49 user nova-compute[72184]:       <deviceboot/>
Aug 01 16:47:49 user nova-compute[72184]:       <disksnapshot default='on' toggle='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     </features>
Aug 01 16:47:49 user nova-compute[72184]:   </guest>
Aug 01 16:47:49 user nova-compute[72184]: </capabilities>
Aug 01 16:47:49 user nova-compute[72184]: 
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-i440fx-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>i686</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='255'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'/>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='lm'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ide</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-q35-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>i686</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='288'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'/>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='lm'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-i440fx-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>i686</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='255'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'/>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='lm'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ide</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-q35-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>i686</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='288'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'/>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='lm'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-i440fx-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>x86_64</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='255'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>efi</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='invtsc'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='rsba'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ide</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-q35-jammy</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>x86_64</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='288'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>efi</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='invtsc'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='rsba'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-i440fx-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>x86_64</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='255'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>efi</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='invtsc'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='rsba'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ide</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 16:47:49 user nova-compute[72184]: <domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 16:47:49 user nova-compute[72184]:   <domain>kvm</domain>
Aug 01 16:47:49 user nova-compute[72184]:   <machine>pc-q35-6.2</machine>
Aug 01 16:47:49 user nova-compute[72184]:   <arch>x86_64</arch>
Aug 01 16:47:49 user nova-compute[72184]:   <vcpu max='288'/>
Aug 01 16:47:49 user nova-compute[72184]:   <iothreads supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:   <os supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='firmware'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>efi</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:     <loader supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>rom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pflash</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='readonly'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='secure'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>yes</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>no</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </loader>
Aug 01 16:47:49 user nova-compute[72184]:   </os>
Aug 01 16:47:49 user nova-compute[72184]:   <cpu>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-passthrough' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='hostPassthroughMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='maximum' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='maximumMigratable'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>on</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>off</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='host-model' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <vendor>Intel</vendor>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ss'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='vmx'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pcid'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='hypervisor'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arat'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='umip'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='md-clear'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='invtsc'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibpb'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='ibrs'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-stibp'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='rsba'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='erms'/>
Aug 01 16:47:49 user nova-compute[72184]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:     <mode name='custom' supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>qemu64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>qemu32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>phenom</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>pentium</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>n270</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm64</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>kvm32</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>coreduo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>core2duo</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>athlon</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Westmere</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Snowridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Skylake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>SandyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Penryn</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G5</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G4</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G3</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Opteron_G2</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Opteron_G1</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>IvyBridge</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Icelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Haswell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Rome</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-Milan</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>EPYC</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Dhyana</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cooperlake</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>Conroe</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='no'>Broadwell</model>
Aug 01 16:47:49 user nova-compute[72184]:       <model usable='yes'>486</model>
Aug 01 16:47:49 user nova-compute[72184]:     </mode>
Aug 01 16:47:49 user nova-compute[72184]:   </cpu>
Aug 01 16:47:49 user nova-compute[72184]:   <memoryBacking supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:     <enum name='sourceType'>
Aug 01 16:47:49 user nova-compute[72184]:       <value>file</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>anonymous</value>
Aug 01 16:47:49 user nova-compute[72184]:       <value>memfd</value>
Aug 01 16:47:49 user nova-compute[72184]:     </enum>
Aug 01 16:47:49 user nova-compute[72184]:   </memoryBacking>
Aug 01 16:47:49 user nova-compute[72184]:   <devices>
Aug 01 16:47:49 user nova-compute[72184]:     <disk supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='diskDevice'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>disk</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cdrom</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>floppy</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>lun</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='bus'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>fdc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sata</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </disk>
Aug 01 16:47:49 user nova-compute[72184]:     <graphics supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='type'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>sdl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vnc</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>spice</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egl-headless</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </graphics>
Aug 01 16:47:49 user nova-compute[72184]:     <video supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='modelType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>cirrus</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>vmvga</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>qxl</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>none</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>bochs</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>ramfb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </video>
Aug 01 16:47:49 user nova-compute[72184]:     <hostdev supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='mode'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>subsystem</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='startupPolicy'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>default</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>mandatory</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>requisite</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>optional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='subsysType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>usb</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>pci</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>scsi</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='capsType'/>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='pciBackend'/>
Aug 01 16:47:49 user nova-compute[72184]:     </hostdev>
Aug 01 16:47:49 user nova-compute[72184]:     <rng supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtio-non-transitional</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>random</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>egd</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>builtin</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </rng>
Aug 01 16:47:49 user nova-compute[72184]:     <filesystem supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='driverType'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>path</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>handle</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>virtiofs</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </filesystem>
Aug 01 16:47:49 user nova-compute[72184]:     <tpm supported='yes'>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='model'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-tis</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>tpm-crb</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:       <enum name='backendModel'>
Aug 01 16:47:49 user nova-compute[72184]:         <value>passthrough</value>
Aug 01 16:47:49 user nova-compute[72184]:         <value>emulator</value>
Aug 01 16:47:49 user nova-compute[72184]:       </enum>
Aug 01 16:47:49 user nova-compute[72184]:     </tpm>
Aug 01 16:47:49 user nova-compute[72184]:   </devices>
Aug 01 16:47:49 user nova-compute[72184]:   <features>
Aug 01 16:47:49 user nova-compute[72184]:     <gic supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:     <vmcoreinfo supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <genid supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backingStoreInput supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <backup supported='yes'/>
Aug 01 16:47:49 user nova-compute[72184]:     <sev supported='no'/>
Aug 01 16:47:49 user nova-compute[72184]:   </features>
Aug 01 16:47:49 user nova-compute[72184]: </domainCapabilities>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Checking secure boot support for host arch (x86_64) {{(pid=72184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Checking secure boot support for host arch (x86_64) {{(pid=72184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Checking secure boot support for host arch (x86_64) {{(pid=72184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 16:47:49 user nova-compute[72184]: INFO nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Secure Boot support detected
Aug 01 16:47:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] cpu compare xml: <cpu match="exact">
Aug 01 16:47:49 user nova-compute[72184]:   <model>Nehalem</model>
Aug 01 16:47:49 user nova-compute[72184]: </cpu>
Aug 01 16:47:49 user nova-compute[72184]:  {{(pid=72184) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 16:47:49 user nova-compute[72184]: INFO nova.virt.node [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Generated node identity 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1
Aug 01 16:47:49 user nova-compute[72184]: INFO nova.virt.node [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Wrote node identity 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 to /opt/stack/data/nova/compute_id
Aug 01 16:47:49 user nova-compute[72184]: WARNING nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Compute nodes ['5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 16:47:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 16:47:50 user nova-compute[72184]: WARNING nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 16:47:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:47:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:47:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Hypervisor/Node resource view: name=user free_ram=10845MB free_disk=26.251564025878906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:47:50 user nova-compute[72184]: WARNING nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] No compute node record for user:5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 could not be found.
Aug 01 16:47:50 user nova-compute[72184]: INFO nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Compute node record created for user:user with uuid: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:47:50 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [req-342dd1fd-9908-4a19-8b72-1f1e73609134] Created resource provider record via placement API for resource provider with UUID 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 and name user.
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72184) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 16:47:50 user nova-compute[72184]: INFO nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] kernel doesn't support AMD SEV
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Libvirt baseline CPU <cpu>
Aug 01 16:47:50 user nova-compute[72184]:   <arch>x86_64</arch>
Aug 01 16:47:50 user nova-compute[72184]:   <model>Nehalem</model>
Aug 01 16:47:50 user nova-compute[72184]:   <vendor>Intel</vendor>
Aug 01 16:47:50 user nova-compute[72184]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 16:47:50 user nova-compute[72184]: </cpu>
Aug 01 16:47:50 user nova-compute[72184]:  {{(pid=72184) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Updated inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Updating resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 generation from 0 to 1 during operation: update_inventory {{(pid=72184) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Updating resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 generation from 1 to 2 during operation: update_traits {{(pid=72184) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.service [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Creating RPC server for service compute {{(pid=72184) start /opt/stack/nova/nova/service.py:182}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.service [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Join ServiceGroup membership for this service compute {{(pid=72184) start /opt/stack/nova/nova/service.py:199}}
Aug 01 16:47:50 user nova-compute[72184]: DEBUG nova.servicegroup.drivers.db [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72184) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 16:47:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:47:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:48:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:48:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=10222MB free_disk=26.155296325683594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:48:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:49:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:49:43 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:49:43 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=10215MB free_disk=26.199893951416016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:49:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:49:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:49:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:50:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:50:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:50:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:50:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:50:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:50:44 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:50:44 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=10211MB free_disk=25.974349975585938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:50:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:50:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:50:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:51:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:51:44 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:51:44 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=9484MB free_disk=25.997310638427734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:51:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "202a214d-94fc-4748-a403-abdbc75a4157" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:51:49 user nova-compute[72184]: INFO nova.compute.claims [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Claim successful on node user
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.333s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:51:49 user nova-compute[72184]: INFO nova.compute.claims [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Claim successful on node user
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:51:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:51:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Creating image(s)
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "/opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "/opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "/opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:51:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:51:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:51:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.policy [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e33dc89b5744c2ad3c0d86f759c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a62e50ced845abbadbe12339265fdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.policy [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5955b0107544c9cbce9e1c5c305cd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3358e9a5875f4d28b190013ad6eed14b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:51:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Creating image(s)
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.part --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.virt.images [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] 445427d2-2c17-4b94-ba10-8b1151983d7e was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.part /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.part /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.converted" returned: 0 in 0.214s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.163s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:51 user nova-compute[72184]: INFO oslo.privsep.daemon [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4rd12gsn/privsep.sock']
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.450s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:51 user sudo[81335]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4rd12gsn/privsep.sock
Aug 01 16:51:51 user sudo[81335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:51:51 user nova-compute[72184]: INFO nova.compute.claims [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Claim successful on node user
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:51:51 user nova-compute[72184]: DEBUG nova.network.neutron [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:51:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:51:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:51:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:51:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:51:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Creating image(s)
Aug 01 16:51:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:52 user nova-compute[72184]: DEBUG nova.policy [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e33dc89b5744c2ad3c0d86f759c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a62e50ced845abbadbe12339265fdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:51:53 user sudo[81335]: pam_unix(sudo:session): session closed for user root
Aug 01 16:51:53 user nova-compute[72184]: INFO oslo.privsep.daemon [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Spawned new privsep daemon via rootwrap
Aug 01 16:51:53 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 16:51:53 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 16:51:53 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 16:51:53 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81340
Aug 01 16:51:53 user nova-compute[72184]: WARNING oslo_privsep.priv_context [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] privsep daemon already running
Aug 01 16:51:53 user nova-compute[72184]: WARNING oslo_privsep.priv_context [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] privsep daemon already running
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.122s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.127s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk 1073741824" returned: 0 in 0.042s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.153s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.171s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.171s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Successfully created port: a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk 1073741824" returned: 0 in 0.048s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.384s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Cannot resize image /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lazy-loading 'migration_context' on Instance uuid 202a214d-94fc-4748-a403-abdbc75a4157 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Ensure instance console log exists: /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.154s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk 1073741824" returned: 0 in 0.043s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Cannot resize image /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'migration_context' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Ensure instance console log exists: /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Cannot resize image /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'migration_context' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Ensure instance console log exists: /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:54 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:51:54 user nova-compute[72184]: INFO nova.compute.claims [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Claim successful on node user
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:51:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Successfully created port: cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:51:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Creating image(s)
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "/opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG nova.policy [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9ae86640754099bb01c48a6807075f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13772bce6fa482189f819cb065170b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.180s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.206s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk 1073741824" returned: 0 in 0.050s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Cannot resize image /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.objects.instance [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'migration_context' on Instance uuid 76785510-2f39-4b4f-a11c-d30f9cd82138 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Ensure instance console log exists: /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Successfully updated port: a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquired lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:51:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Successfully created port: 9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-changed-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Refreshing instance network info cache due to event network-changed-a165456d-91a5-4197-bc19-86eba2a1cec6. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] Acquiring lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updating instance_info_cache with network_info: [{"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Releasing lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Instance network_info: |[{"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] Acquired lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Refreshing network info cache for port a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Start _get_guest_xml network_info=[{"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:51:57 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:51:57 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2112282104',display_name='tempest-ServersNegativeTestJSON-server-2112282104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2112282104',id=1,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3358e9a5875f4d28b190013ad6eed14b',ramdisk_id='',reservation_id='r-y1pgaobp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2037366998',owner_user_name='tempest-ServersNegativeTestJSON-2037366998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:50Z,user_data=None,user_id='d5955b0107544c9cbce9e1c5c305cd3d',uuid=202a214d-94fc-4748-a403-abdbc75a4157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converting VIF {"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lazy-loading 'pci_devices' on Instance uuid 202a214d-94fc-4748-a403-abdbc75a4157 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:51:57 user nova-compute[72184]:   <uuid>202a214d-94fc-4748-a403-abdbc75a4157</uuid>
Aug 01 16:51:57 user nova-compute[72184]:   <name>instance-00000001</name>
Aug 01 16:51:57 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:51:57 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:51:57 user nova-compute[72184]:   <metadata>
Aug 01 16:51:57 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:51:57 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:51:57 user nova-compute[72184]:       <nova:name>tempest-ServersNegativeTestJSON-server-2112282104</nova:name>
Aug 01 16:51:57 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:51:57</nova:creationTime>
Aug 01 16:51:57 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:51:57 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:51:57 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:51:57 user nova-compute[72184]:       <nova:owner>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:user uuid="d5955b0107544c9cbce9e1c5c305cd3d">tempest-ServersNegativeTestJSON-2037366998-project-member</nova:user>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:project uuid="3358e9a5875f4d28b190013ad6eed14b">tempest-ServersNegativeTestJSON-2037366998</nova:project>
Aug 01 16:51:57 user nova-compute[72184]:       </nova:owner>
Aug 01 16:51:57 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:51:57 user nova-compute[72184]:       <nova:ports>
Aug 01 16:51:57 user nova-compute[72184]:         <nova:port uuid="a165456d-91a5-4197-bc19-86eba2a1cec6">
Aug 01 16:51:57 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 16:51:57 user nova-compute[72184]:         </nova:port>
Aug 01 16:51:57 user nova-compute[72184]:       </nova:ports>
Aug 01 16:51:57 user nova-compute[72184]:     </nova:instance>
Aug 01 16:51:57 user nova-compute[72184]:   </metadata>
Aug 01 16:51:57 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:51:57 user nova-compute[72184]:     <system>
Aug 01 16:51:57 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:51:57 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:51:57 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:51:57 user nova-compute[72184]:       <entry name="serial">202a214d-94fc-4748-a403-abdbc75a4157</entry>
Aug 01 16:51:57 user nova-compute[72184]:       <entry name="uuid">202a214d-94fc-4748-a403-abdbc75a4157</entry>
Aug 01 16:51:57 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:51:57 user nova-compute[72184]:     </system>
Aug 01 16:51:57 user nova-compute[72184]:   </sysinfo>
Aug 01 16:51:57 user nova-compute[72184]:   <os>
Aug 01 16:51:57 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:51:57 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:51:57 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:51:57 user nova-compute[72184]:   </os>
Aug 01 16:51:57 user nova-compute[72184]:   <features>
Aug 01 16:51:57 user nova-compute[72184]:     <acpi/>
Aug 01 16:51:57 user nova-compute[72184]:     <apic/>
Aug 01 16:51:57 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:51:57 user nova-compute[72184]:   </features>
Aug 01 16:51:57 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:51:57 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:51:57 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:51:57 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:51:57 user nova-compute[72184]:   </clock>
Aug 01 16:51:57 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:51:57 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:51:57 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:51:57 user nova-compute[72184]:   </cpu>
Aug 01 16:51:57 user nova-compute[72184]:   <devices>
Aug 01 16:51:57 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:51:57 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:51:57 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk"/>
Aug 01 16:51:57 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:51:57 user nova-compute[72184]:     </disk>
Aug 01 16:51:57 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:51:57 user nova-compute[72184]:       <mac address="fa:16:3e:e5:6a:1e"/>
Aug 01 16:51:57 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:51:57 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:51:57 user nova-compute[72184]:       <target dev="tapa165456d-91"/>
Aug 01 16:51:57 user nova-compute[72184]:     </interface>
Aug 01 16:51:57 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:51:57 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/console.log" append="off"/>
Aug 01 16:51:57 user nova-compute[72184]:     </serial>
Aug 01 16:51:57 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:51:57 user nova-compute[72184]:     <video>
Aug 01 16:51:57 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:51:57 user nova-compute[72184]:     </video>
Aug 01 16:51:57 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:51:57 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:51:57 user nova-compute[72184]:     </rng>
Aug 01 16:51:57 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:51:57 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:51:57 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:51:57 user nova-compute[72184]:     </memballoon>
Aug 01 16:51:57 user nova-compute[72184]:   </devices>
Aug 01 16:51:57 user nova-compute[72184]: </domain>
Aug 01 16:51:57 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2112282104',display_name='tempest-ServersNegativeTestJSON-server-2112282104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2112282104',id=1,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3358e9a5875f4d28b190013ad6eed14b',ramdisk_id='',reservation_id='r-y1pgaobp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2037366998',owner_user_name='tempest-ServersNegativeTestJSON-2037366998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:50Z,user_data=None,user_id='d5955b0107544c9cbce9e1c5c305cd3d',uuid=202a214d-94fc-4748-a403-abdbc75a4157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converting VIF {"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:51:57 user nova-compute[72184]: DEBUG os_vif [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Created schema index Interface.name {{(pid=72184) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Created schema index Port.name {{(pid=72184) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Created schema index Bridge.name {{(pid=72184) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [POLLOUT] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:51:58 user nova-compute[72184]: INFO oslo.privsep.daemon [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpdwf3ny5y/privsep.sock']
Aug 01 16:51:58 user sudo[81407]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpdwf3ny5y/privsep.sock
Aug 01 16:51:58 user sudo[81407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 16:51:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Successfully created port: 9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updated VIF entry in instance network info cache for port a165456d-91a5-4197-bc19-86eba2a1cec6. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updating instance_info_cache with network_info: [{"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:51:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-80b207df-7fc3-4166-9aa3-a8b7727cd17f req-0707835d-4fae-4ff4-842f-15bd4059eb02 service nova] Releasing lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:51:59 user sudo[81407]: pam_unix(sudo:session): session closed for user root
Aug 01 16:51:59 user nova-compute[72184]: INFO oslo.privsep.daemon [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Spawned new privsep daemon via rootwrap
Aug 01 16:51:59 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 16:51:59 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 16:51:59 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 16:51:59 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81410
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa165456d-91, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa165456d-91, col_values=(('external_ids', {'iface-id': 'a165456d-91a5-4197-bc19-86eba2a1cec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:6a:1e', 'vm-uuid': '202a214d-94fc-4748-a403-abdbc75a4157'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:00 user nova-compute[72184]: INFO os_vif [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91')
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] No VIF found with MAC fa:16:3e:e5:6a:1e, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:00 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Successfully updated port: 9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:52:01 user nova-compute[72184]: INFO nova.compute.claims [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Claim successful on node user
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Successfully updated port: cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-changed-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Refreshing instance network info cache due to event network-changed-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] Acquiring lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:52:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Successfully updated port: 9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-changed-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Refreshing instance network info cache due to event network-changed-cc34cd3a-a1e6-4473-9679-b45d861b80ac. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:52:02 user nova-compute[72184]: INFO nova.compute.claims [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Claim successful on node user
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.policy [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe5c17c4d0a84d27ad28486da91673bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac23356679f461282fce02ad71f2442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:52:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Creating image(s)
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "/opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "/opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.172s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Instance network_info: |[{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] Acquired lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.neutron [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Refreshing network info cache for port 9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Start _get_guest_xml network_info=[{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.216s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk 1073741824" returned: 0 in 0.085s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-382219524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-382219524',id=4,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-bqkkxd8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:56Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=76785510-2f39-4b4f-a11c-d30f9cd82138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.objects.instance [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'pci_devices' on Instance uuid 76785510-2f39-4b4f-a11c-d30f9cd82138 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:02 user nova-compute[72184]:   <uuid>76785510-2f39-4b4f-a11c-d30f9cd82138</uuid>
Aug 01 16:52:02 user nova-compute[72184]:   <name>instance-00000004</name>
Aug 01 16:52:02 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:02 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:02 user nova-compute[72184]:   <metadata>
Aug 01 16:52:02 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:02 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:02 user nova-compute[72184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-382219524</nova:name>
Aug 01 16:52:02 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:02</nova:creationTime>
Aug 01 16:52:02 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:02 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:02 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:02 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:user uuid="1b9ae86640754099bb01c48a6807075f">tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member</nova:user>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:project uuid="b13772bce6fa482189f819cb065170b3">tempest-ServerBootFromVolumeStableRescueTest-388641611</nova:project>
Aug 01 16:52:02 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:02 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:02 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:02 user nova-compute[72184]:         <nova:port uuid="9b06f6e5-8d35-4eb3-9768-03cfcb58cd80">
Aug 01 16:52:02 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 16:52:02 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:02 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:02 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:02 user nova-compute[72184]:   </metadata>
Aug 01 16:52:02 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:02 user nova-compute[72184]:     <system>
Aug 01 16:52:02 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:02 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:02 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:02 user nova-compute[72184]:       <entry name="serial">76785510-2f39-4b4f-a11c-d30f9cd82138</entry>
Aug 01 16:52:02 user nova-compute[72184]:       <entry name="uuid">76785510-2f39-4b4f-a11c-d30f9cd82138</entry>
Aug 01 16:52:02 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:02 user nova-compute[72184]:     </system>
Aug 01 16:52:02 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:02 user nova-compute[72184]:   <os>
Aug 01 16:52:02 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:02 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:02 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:02 user nova-compute[72184]:   </os>
Aug 01 16:52:02 user nova-compute[72184]:   <features>
Aug 01 16:52:02 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:02 user nova-compute[72184]:     <apic/>
Aug 01 16:52:02 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:02 user nova-compute[72184]:   </features>
Aug 01 16:52:02 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:02 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:02 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:02 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:02 user nova-compute[72184]:   </clock>
Aug 01 16:52:02 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:02 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:02 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:02 user nova-compute[72184]:   </cpu>
Aug 01 16:52:02 user nova-compute[72184]:   <devices>
Aug 01 16:52:02 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:02 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:02 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk"/>
Aug 01 16:52:02 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:02 user nova-compute[72184]:     </disk>
Aug 01 16:52:02 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:02 user nova-compute[72184]:       <mac address="fa:16:3e:56:c7:e6"/>
Aug 01 16:52:02 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:02 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:02 user nova-compute[72184]:       <target dev="tap9b06f6e5-8d"/>
Aug 01 16:52:02 user nova-compute[72184]:     </interface>
Aug 01 16:52:02 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:02 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/console.log" append="off"/>
Aug 01 16:52:02 user nova-compute[72184]:     </serial>
Aug 01 16:52:02 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:02 user nova-compute[72184]:     <video>
Aug 01 16:52:02 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:02 user nova-compute[72184]:     </video>
Aug 01 16:52:02 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:02 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:02 user nova-compute[72184]:     </rng>
Aug 01 16:52:02 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:02 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:02 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:02 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:02 user nova-compute[72184]:   </devices>
Aug 01 16:52:02 user nova-compute[72184]: </domain>
Aug 01 16:52:02 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-382219524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-382219524',id=4,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-bqkkxd8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:56Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=76785510-2f39-4b4f-a11c-d30f9cd82138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG os_vif [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.186s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.942s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b06f6e5-8d, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b06f6e5-8d, col_values=(('external_ids', {'iface-id': '9b06f6e5-8d35-4eb3-9768-03cfcb58cd80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:c7:e6', 'vm-uuid': '76785510-2f39-4b4f-a11c-d30f9cd82138'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:02 user nova-compute[72184]: INFO os_vif [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d')
Aug 01 16:52:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Cannot resize image /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'migration_context' on Instance uuid 7b407b54-6887-4b20-a3ae-50a2ce5777be {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-1cc911ba-0728-4919-9b4c-f3e9ef6635b4 req-fa7eec1e-f856-4108-9100-bb3bcf5ad5ff service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1cc911ba-0728-4919-9b4c-f3e9ef6635b4 req-fa7eec1e-f856-4108-9100-bb3bcf5ad5ff service nova] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1cc911ba-0728-4919-9b4c-f3e9ef6635b4 req-fa7eec1e-f856-4108-9100-bb3bcf5ad5ff service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1cc911ba-0728-4919-9b4c-f3e9ef6635b4 req-fa7eec1e-f856-4108-9100-bb3bcf5ad5ff service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-1cc911ba-0728-4919-9b4c-f3e9ef6635b4 req-fa7eec1e-f856-4108-9100-bb3bcf5ad5ff service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] No waiting events found dispatching network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:03 user nova-compute[72184]: WARNING nova.compute.manager [req-1cc911ba-0728-4919-9b4c-f3e9ef6635b4 req-fa7eec1e-f856-4108-9100-bb3bcf5ad5ff service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received unexpected event network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 for instance with vm_state building and task_state spawning.
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No VIF found with MAC fa:16:3e:56:c7:e6, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Ensure instance console log exists: /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.policy [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '154bf9bc1d904d55a86bd739a2f65677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7490e7fdbe46cd8618b6431046108b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance network_info: |[{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Refreshing network info cache for port cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Start _get_guest_xml network_info=[{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:52:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Creating image(s)
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:03 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:03 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1697013999',display_name='tempest-ServerRescueNegativeTestJSON-server-1697013999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1697013999',id=2,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-p32h0ws3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:51Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=75c3c16a-8768-4b24-8469-35b77664a71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'pci_devices' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updating instance_info_cache with network_info: [{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.187s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:03 user nova-compute[72184]:   <uuid>75c3c16a-8768-4b24-8469-35b77664a71e</uuid>
Aug 01 16:52:03 user nova-compute[72184]:   <name>instance-00000002</name>
Aug 01 16:52:03 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:03 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:03 user nova-compute[72184]:   <metadata>
Aug 01 16:52:03 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:03 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1697013999</nova:name>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:03</nova:creationTime>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:03 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:03 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:user uuid="b0e33dc89b5744c2ad3c0d86f759c9c3">tempest-ServerRescueNegativeTestJSON-353659352-project-member</nova:user>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:project uuid="e0a62e50ced845abbadbe12339265fdc">tempest-ServerRescueNegativeTestJSON-353659352</nova:project>
Aug 01 16:52:03 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:port uuid="cc34cd3a-a1e6-4473-9679-b45d861b80ac">
Aug 01 16:52:03 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 16:52:03 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:03 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:03 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:03 user nova-compute[72184]:   </metadata>
Aug 01 16:52:03 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:03 user nova-compute[72184]:     <system>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="serial">75c3c16a-8768-4b24-8469-35b77664a71e</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="uuid">75c3c16a-8768-4b24-8469-35b77664a71e</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:03 user nova-compute[72184]:     </system>
Aug 01 16:52:03 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:03 user nova-compute[72184]:   <os>
Aug 01 16:52:03 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:03 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:03 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:03 user nova-compute[72184]:   </os>
Aug 01 16:52:03 user nova-compute[72184]:   <features>
Aug 01 16:52:03 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:03 user nova-compute[72184]:     <apic/>
Aug 01 16:52:03 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:03 user nova-compute[72184]:   </features>
Aug 01 16:52:03 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:03 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:03 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:03 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:03 user nova-compute[72184]:   </clock>
Aug 01 16:52:03 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:03 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:03 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:03 user nova-compute[72184]:   </cpu>
Aug 01 16:52:03 user nova-compute[72184]:   <devices>
Aug 01 16:52:03 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:03 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:03 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk"/>
Aug 01 16:52:03 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:03 user nova-compute[72184]:     </disk>
Aug 01 16:52:03 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:03 user nova-compute[72184]:       <mac address="fa:16:3e:da:95:ed"/>
Aug 01 16:52:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:03 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:03 user nova-compute[72184]:       <target dev="tapcc34cd3a-a1"/>
Aug 01 16:52:03 user nova-compute[72184]:     </interface>
Aug 01 16:52:03 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:03 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/console.log" append="off"/>
Aug 01 16:52:03 user nova-compute[72184]:     </serial>
Aug 01 16:52:03 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:03 user nova-compute[72184]:     <video>
Aug 01 16:52:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:03 user nova-compute[72184]:     </video>
Aug 01 16:52:03 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:03 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:03 user nova-compute[72184]:     </rng>
Aug 01 16:52:03 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:03 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:03 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:03 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:03 user nova-compute[72184]:   </devices>
Aug 01 16:52:03 user nova-compute[72184]: </domain>
Aug 01 16:52:03 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1697013999',display_name='tempest-ServerRescueNegativeTestJSON-server-1697013999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1697013999',id=2,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-p32h0ws3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:51Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=75c3c16a-8768-4b24-8469-35b77664a71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG os_vif [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance network_info: |[{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Start _get_guest_xml network_info=[{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc34cd3a-a1, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc34cd3a-a1, col_values=(('external_ids', {'iface-id': 'cc34cd3a-a1e6-4473-9679-b45d861b80ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:95:ed', 'vm-uuid': '75c3c16a-8768-4b24-8469-35b77664a71e'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: INFO os_vif [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1')
Aug 01 16:52:03 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:03 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556921540',display_name='tempest-ServerRescueNegativeTestJSON-server-1556921540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556921540',id=3,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-16ucxoey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:52Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=a8b17402-c090-4e22-8ca7-06df5361d20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'pci_devices' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.201s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:03 user nova-compute[72184]:   <uuid>a8b17402-c090-4e22-8ca7-06df5361d20c</uuid>
Aug 01 16:52:03 user nova-compute[72184]:   <name>instance-00000003</name>
Aug 01 16:52:03 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:03 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:03 user nova-compute[72184]:   <metadata>
Aug 01 16:52:03 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:03 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1556921540</nova:name>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:03</nova:creationTime>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:03 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:03 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:user uuid="b0e33dc89b5744c2ad3c0d86f759c9c3">tempest-ServerRescueNegativeTestJSON-353659352-project-member</nova:user>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:project uuid="e0a62e50ced845abbadbe12339265fdc">tempest-ServerRescueNegativeTestJSON-353659352</nova:project>
Aug 01 16:52:03 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:03 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:03 user nova-compute[72184]:         <nova:port uuid="9529a526-8677-4545-bd95-3fecdfa3c8ed">
Aug 01 16:52:03 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:52:03 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:03 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:03 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:03 user nova-compute[72184]:   </metadata>
Aug 01 16:52:03 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:03 user nova-compute[72184]:     <system>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="serial">a8b17402-c090-4e22-8ca7-06df5361d20c</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="uuid">a8b17402-c090-4e22-8ca7-06df5361d20c</entry>
Aug 01 16:52:03 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:03 user nova-compute[72184]:     </system>
Aug 01 16:52:03 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:03 user nova-compute[72184]:   <os>
Aug 01 16:52:03 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:03 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:03 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:03 user nova-compute[72184]:   </os>
Aug 01 16:52:03 user nova-compute[72184]:   <features>
Aug 01 16:52:03 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:03 user nova-compute[72184]:     <apic/>
Aug 01 16:52:03 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:03 user nova-compute[72184]:   </features>
Aug 01 16:52:03 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:03 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:03 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:03 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:03 user nova-compute[72184]:   </clock>
Aug 01 16:52:03 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:03 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:03 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:03 user nova-compute[72184]:   </cpu>
Aug 01 16:52:03 user nova-compute[72184]:   <devices>
Aug 01 16:52:03 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:03 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:03 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk"/>
Aug 01 16:52:03 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:03 user nova-compute[72184]:     </disk>
Aug 01 16:52:03 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:03 user nova-compute[72184]:       <mac address="fa:16:3e:c4:f0:f6"/>
Aug 01 16:52:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:03 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:03 user nova-compute[72184]:       <target dev="tap9529a526-86"/>
Aug 01 16:52:03 user nova-compute[72184]:     </interface>
Aug 01 16:52:03 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:03 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/console.log" append="off"/>
Aug 01 16:52:03 user nova-compute[72184]:     </serial>
Aug 01 16:52:03 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:03 user nova-compute[72184]:     <video>
Aug 01 16:52:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:03 user nova-compute[72184]:     </video>
Aug 01 16:52:03 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:03 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:03 user nova-compute[72184]:     </rng>
Aug 01 16:52:03 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:03 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:03 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:03 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:03 user nova-compute[72184]:   </devices>
Aug 01 16:52:03 user nova-compute[72184]: </domain>
Aug 01 16:52:03 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556921540',display_name='tempest-ServerRescueNegativeTestJSON-server-1556921540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556921540',id=3,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-16ucxoey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:51:52Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=a8b17402-c090-4e22-8ca7-06df5361d20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG os_vif [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908723.8261995, 202a214d-94fc-4748-a403-abdbc75a4157 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:03 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] VM Resumed (Lifecycle Event)
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk 1073741824" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9529a526-86, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9529a526-86, col_values=(('external_ids', {'iface-id': '9529a526-8677-4545-bd95-3fecdfa3c8ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:f0:f6', 'vm-uuid': 'a8b17402-c090-4e22-8ca7-06df5361d20c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:da:95:ed, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:04 user nova-compute[72184]: INFO os_vif [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86')
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Instance spawned successfully.
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.203s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updated VIF entry in instance network info cache for port 9b06f6e5-8d35-4eb3-9768-03cfcb58cd80. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:04 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908723.8271048, 202a214d-94fc-4748-a403-abdbc75a4157 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:04 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] VM Started (Lifecycle Event)
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-changed-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Refreshing instance network info cache due to event network-changed-9529a526-8677-4545-bd95-3fecdfa3c8ed. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] Acquiring lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] Acquired lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Refreshing network info cache for port 9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3a5cfd6b-14cb-4aa0-b311-db116d55d0e5 req-a7c23ffe-9761-4083-9258-1380fb89d813 service nova] Releasing lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:c4:f0:f6, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Cannot resize image /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'migration_context' on Instance uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Ensure instance console log exists: /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:04 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:04 user nova-compute[72184]: INFO nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Took 14.10 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:04 user nova-compute[72184]: INFO nova.compute.manager [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Took 14.99 seconds to build instance.
Aug 01 16:52:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c36ffaad-08dd-4e2b-b5a9-e10075f069e4 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "202a214d-94fc-4748-a403-abdbc75a4157" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.211s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Successfully created port: 05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updated VIF entry in instance network info cache for port 9529a526-8677-4545-bd95-3fecdfa3c8ed. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updating instance_info_cache with network_info: [{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8bf68bff-b72b-4927-86b9-5a2cf845d65f req-746f23c1-893e-4cf9-8c8b-c3d5ba7c90d3 service nova] Releasing lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-f2585bbf-e3bf-48a9-8907-f4f4ab1c96e6 req-7043cda2-108e-41ca-82db-e2405bc86ce0 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f2585bbf-e3bf-48a9-8907-f4f4ab1c96e6 req-7043cda2-108e-41ca-82db-e2405bc86ce0 service nova] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f2585bbf-e3bf-48a9-8907-f4f4ab1c96e6 req-7043cda2-108e-41ca-82db-e2405bc86ce0 service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f2585bbf-e3bf-48a9-8907-f4f4ab1c96e6 req-7043cda2-108e-41ca-82db-e2405bc86ce0 service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-f2585bbf-e3bf-48a9-8907-f4f4ab1c96e6 req-7043cda2-108e-41ca-82db-e2405bc86ce0 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] No waiting events found dispatching network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:05 user nova-compute[72184]: WARNING nova.compute.manager [req-f2585bbf-e3bf-48a9-8907-f4f4ab1c96e6 req-7043cda2-108e-41ca-82db-e2405bc86ce0 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received unexpected event network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 for instance with vm_state active and task_state None.
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Successfully created port: 0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updated VIF entry in instance network info cache for port cc34cd3a-a1e6-4473-9679-b45d861b80ac. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fff251ef-e6ce-4278-8e8e-e9c335ee7f76 req-02fa1d0e-c661-44ad-9325-ad075b7903a6 service nova] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Successfully updated port: 05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquired lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-changed-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Refreshing instance network info cache due to event network-changed-05c07b8d-e31d-4dce-8b1b-ac6047c29540. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] Acquiring lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f5ff183-eca2-420e-b72e-da088d315ebf req-b5d1cc28-8e28-4d56-9e4f-8570868d1cbf service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f5ff183-eca2-420e-b72e-da088d315ebf req-b5d1cc28-8e28-4d56-9e4f-8570868d1cbf service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f5ff183-eca2-420e-b72e-da088d315ebf req-b5d1cc28-8e28-4d56-9e4f-8570868d1cbf service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f5ff183-eca2-420e-b72e-da088d315ebf req-b5d1cc28-8e28-4d56-9e4f-8570868d1cbf service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f5ff183-eca2-420e-b72e-da088d315ebf req-b5d1cc28-8e28-4d56-9e4f-8570868d1cbf service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:06 user nova-compute[72184]: WARNING nova.compute.manager [req-2f5ff183-eca2-420e-b72e-da088d315ebf req-b5d1cc28-8e28-4d56-9e4f-8570868d1cbf service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state building and task_state spawning.
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updating instance_info_cache with network_info: [{"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Releasing lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Instance network_info: |[{"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] Acquired lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.network.neutron [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Refreshing network info cache for port 05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Start _get_guest_xml network_info=[{"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:06 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:06 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-316335542',display_name='tempest-AttachVolumeNegativeTest-server-316335542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-316335542',id=6,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiR7kc3NyKOWFq+fqjHZPnGt0Lo256a/PvNUfxMjRWQXpWl/WW4Qk7BsOwwYjDbnYAo9p/vabvgAicd/UCH8COe1ZlAxGNJxD2YoJ7ON7PQUAQWGkVE48yjB3Q4+EPx9g==',key_name='tempest-keypair-313393892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-b0w30oze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=8d331546-ccb4-4794-b3b8-ef5049640db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:07 user nova-compute[72184]:   <uuid>8d331546-ccb4-4794-b3b8-ef5049640db6</uuid>
Aug 01 16:52:07 user nova-compute[72184]:   <name>instance-00000006</name>
Aug 01 16:52:07 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:07 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:07 user nova-compute[72184]:   <metadata>
Aug 01 16:52:07 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:07 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:07 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-316335542</nova:name>
Aug 01 16:52:07 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:06</nova:creationTime>
Aug 01 16:52:07 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:07 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:07 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:07 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:user uuid="154bf9bc1d904d55a86bd739a2f65677">tempest-AttachVolumeNegativeTest-1778743204-project-member</nova:user>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:project uuid="9b7490e7fdbe46cd8618b6431046108b">tempest-AttachVolumeNegativeTest-1778743204</nova:project>
Aug 01 16:52:07 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:07 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:07 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:07 user nova-compute[72184]:         <nova:port uuid="05c07b8d-e31d-4dce-8b1b-ac6047c29540">
Aug 01 16:52:07 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 16:52:07 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:07 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:07 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:07 user nova-compute[72184]:   </metadata>
Aug 01 16:52:07 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:07 user nova-compute[72184]:     <system>
Aug 01 16:52:07 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:07 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:07 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:07 user nova-compute[72184]:       <entry name="serial">8d331546-ccb4-4794-b3b8-ef5049640db6</entry>
Aug 01 16:52:07 user nova-compute[72184]:       <entry name="uuid">8d331546-ccb4-4794-b3b8-ef5049640db6</entry>
Aug 01 16:52:07 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:07 user nova-compute[72184]:     </system>
Aug 01 16:52:07 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:07 user nova-compute[72184]:   <os>
Aug 01 16:52:07 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:07 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:07 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:07 user nova-compute[72184]:   </os>
Aug 01 16:52:07 user nova-compute[72184]:   <features>
Aug 01 16:52:07 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:07 user nova-compute[72184]:     <apic/>
Aug 01 16:52:07 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:07 user nova-compute[72184]:   </features>
Aug 01 16:52:07 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:07 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:07 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:07 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:07 user nova-compute[72184]:   </clock>
Aug 01 16:52:07 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:07 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:07 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:07 user nova-compute[72184]:   </cpu>
Aug 01 16:52:07 user nova-compute[72184]:   <devices>
Aug 01 16:52:07 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:07 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:07 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk"/>
Aug 01 16:52:07 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:07 user nova-compute[72184]:     </disk>
Aug 01 16:52:07 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:07 user nova-compute[72184]:       <mac address="fa:16:3e:64:52:f0"/>
Aug 01 16:52:07 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:07 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:07 user nova-compute[72184]:       <target dev="tap05c07b8d-e3"/>
Aug 01 16:52:07 user nova-compute[72184]:     </interface>
Aug 01 16:52:07 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:07 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/console.log" append="off"/>
Aug 01 16:52:07 user nova-compute[72184]:     </serial>
Aug 01 16:52:07 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:07 user nova-compute[72184]:     <video>
Aug 01 16:52:07 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:07 user nova-compute[72184]:     </video>
Aug 01 16:52:07 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:07 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:07 user nova-compute[72184]:     </rng>
Aug 01 16:52:07 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:07 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:07 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:07 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:07 user nova-compute[72184]:   </devices>
Aug 01 16:52:07 user nova-compute[72184]: </domain>
Aug 01 16:52:07 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-316335542',display_name='tempest-AttachVolumeNegativeTest-server-316335542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-316335542',id=6,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiR7kc3NyKOWFq+fqjHZPnGt0Lo256a/PvNUfxMjRWQXpWl/WW4Qk7BsOwwYjDbnYAo9p/vabvgAicd/UCH8COe1ZlAxGNJxD2YoJ7ON7PQUAQWGkVE48yjB3Q4+EPx9g==',key_name='tempest-keypair-313393892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-b0w30oze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=8d331546-ccb4-4794-b3b8-ef5049640db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG os_vif [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05c07b8d-e3, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05c07b8d-e3, col_values=(('external_ids', {'iface-id': '05c07b8d-e31d-4dce-8b1b-ac6047c29540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:52:f0', 'vm-uuid': '8d331546-ccb4-4794-b3b8-ef5049640db6'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:07 user nova-compute[72184]: INFO os_vif [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3')
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:64:52:f0, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updated VIF entry in instance network info cache for port 05c07b8d-e31d-4dce-8b1b-ac6047c29540. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updating instance_info_cache with network_info: [{"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8f73abdf-fa6c-4a2d-adcf-522877fc2cde req-06657328-1a67-4c63-afbf-9bb34e03a598 service nova] Releasing lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Successfully updated port: 0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-changed-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Refreshing instance network info cache due to event network-changed-0f436652-34b6-45b4-bf2b-0eaea58addd0. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] Acquiring lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] Acquired lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Refreshing network info cache for port 0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-4d392eec-df62-4282-b3c8-db3d5d8bb670 req-99aef648-3ec8-4d16-b61e-6c38d5017e0e service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4d392eec-df62-4282-b3c8-db3d5d8bb670 req-99aef648-3ec8-4d16-b61e-6c38d5017e0e service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4d392eec-df62-4282-b3c8-db3d5d8bb670 req-99aef648-3ec8-4d16-b61e-6c38d5017e0e service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4d392eec-df62-4282-b3c8-db3d5d8bb670 req-99aef648-3ec8-4d16-b61e-6c38d5017e0e service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-4d392eec-df62-4282-b3c8-db3d5d8bb670 req-99aef648-3ec8-4d16-b61e-6c38d5017e0e service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:08 user nova-compute[72184]: WARNING nova.compute.manager [req-4d392eec-df62-4282-b3c8-db3d5d8bb670 req-99aef648-3ec8-4d16-b61e-6c38d5017e0e service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state building and task_state spawning.
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-1b1826ce-9027-4228-a8d5-d2b02b5264ff req-7d7de046-7ad4-427b-89de-efdbd767f56e service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1b1826ce-9027-4228-a8d5-d2b02b5264ff req-7d7de046-7ad4-427b-89de-efdbd767f56e service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1b1826ce-9027-4228-a8d5-d2b02b5264ff req-7d7de046-7ad4-427b-89de-efdbd767f56e service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1b1826ce-9027-4228-a8d5-d2b02b5264ff req-7d7de046-7ad4-427b-89de-efdbd767f56e service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-1b1826ce-9027-4228-a8d5-d2b02b5264ff req-7d7de046-7ad4-427b-89de-efdbd767f56e service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:08 user nova-compute[72184]: WARNING nova.compute.manager [req-1b1826ce-9027-4228-a8d5-d2b02b5264ff req-7d7de046-7ad4-427b-89de-efdbd767f56e service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state building and task_state spawning.
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-504af0a6-be63-4300-8be5-546b0129967d req-30d9bb47-c6f2-4c5e-80ee-a1fef5cbaf33 service nova] Releasing lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquired lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:52:10 user nova-compute[72184]: INFO nova.compute.claims [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Claim successful on node user
Aug 01 16:52:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-c95f4f66-3f7a-49b4-93f9-4d8fba75f507 req-17b0a6e3-06ba-4f36-89d4-196098857acd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c95f4f66-3f7a-49b4-93f9-4d8fba75f507 req-17b0a6e3-06ba-4f36-89d4-196098857acd service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c95f4f66-3f7a-49b4-93f9-4d8fba75f507 req-17b0a6e3-06ba-4f36-89d4-196098857acd service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c95f4f66-3f7a-49b4-93f9-4d8fba75f507 req-17b0a6e3-06ba-4f36-89d4-196098857acd service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-c95f4f66-3f7a-49b4-93f9-4d8fba75f507 req-17b0a6e3-06ba-4f36-89d4-196098857acd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:10 user nova-compute[72184]: WARNING nova.compute.manager [req-c95f4f66-3f7a-49b4-93f9-4d8fba75f507 req-17b0a6e3-06ba-4f36-89d4-196098857acd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state building and task_state spawning.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-990bd89d-1f13-41aa-9cd4-cfc8769225dc req-6bb36555-af5d-4fa9-bc0a-ec7e794f172b service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-990bd89d-1f13-41aa-9cd4-cfc8769225dc req-6bb36555-af5d-4fa9-bc0a-ec7e794f172b service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-990bd89d-1f13-41aa-9cd4-cfc8769225dc req-6bb36555-af5d-4fa9-bc0a-ec7e794f172b service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-990bd89d-1f13-41aa-9cd4-cfc8769225dc req-6bb36555-af5d-4fa9-bc0a-ec7e794f172b service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-990bd89d-1f13-41aa-9cd4-cfc8769225dc req-6bb36555-af5d-4fa9-bc0a-ec7e794f172b service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:11 user nova-compute[72184]: WARNING nova.compute.manager [req-990bd89d-1f13-41aa-9cd4-cfc8769225dc req-6bb36555-af5d-4fa9-bc0a-ec7e794f172b service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state building and task_state spawning.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updating instance_info_cache with network_info: [{"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Releasing lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Instance network_info: |[{"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Start _get_guest_xml network_info=[{"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-623125351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-623125351',id=5,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqBQaHRmRQCVjgHiCHshJwLFnDOChFlAONZJtpK/iL6UO2w5TfdE+orrMFJTJwYeiLFxUppypnuUzUjUtQy+Mfbt8WhDUcbIQQl9rd5QartVEXEALGbanAD3iDGMaS+WA==',key_name='tempest-keypair-1293735261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-b16eyn80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=7b407b54-6887-4b20-a3ae-50a2ce5777be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b407b54-6887-4b20-a3ae-50a2ce5777be {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:11 user nova-compute[72184]:   <uuid>7b407b54-6887-4b20-a3ae-50a2ce5777be</uuid>
Aug 01 16:52:11 user nova-compute[72184]:   <name>instance-00000005</name>
Aug 01 16:52:11 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:11 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:11 user nova-compute[72184]:   <metadata>
Aug 01 16:52:11 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:11 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:11 user nova-compute[72184]:       <nova:name>tempest-ServerActionsV293TestJSON-server-623125351</nova:name>
Aug 01 16:52:11 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:11</nova:creationTime>
Aug 01 16:52:11 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:11 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:11 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:11 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:user uuid="fe5c17c4d0a84d27ad28486da91673bd">tempest-ServerActionsV293TestJSON-637338544-project-member</nova:user>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:project uuid="0ac23356679f461282fce02ad71f2442">tempest-ServerActionsV293TestJSON-637338544</nova:project>
Aug 01 16:52:11 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:11 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:11 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:11 user nova-compute[72184]:         <nova:port uuid="0f436652-34b6-45b4-bf2b-0eaea58addd0">
Aug 01 16:52:11 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 16:52:11 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:11 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:11 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:11 user nova-compute[72184]:   </metadata>
Aug 01 16:52:11 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:11 user nova-compute[72184]:     <system>
Aug 01 16:52:11 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:11 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:11 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:11 user nova-compute[72184]:       <entry name="serial">7b407b54-6887-4b20-a3ae-50a2ce5777be</entry>
Aug 01 16:52:11 user nova-compute[72184]:       <entry name="uuid">7b407b54-6887-4b20-a3ae-50a2ce5777be</entry>
Aug 01 16:52:11 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:11 user nova-compute[72184]:     </system>
Aug 01 16:52:11 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:11 user nova-compute[72184]:   <os>
Aug 01 16:52:11 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:11 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:11 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:11 user nova-compute[72184]:   </os>
Aug 01 16:52:11 user nova-compute[72184]:   <features>
Aug 01 16:52:11 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:11 user nova-compute[72184]:     <apic/>
Aug 01 16:52:11 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:11 user nova-compute[72184]:   </features>
Aug 01 16:52:11 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:11 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:11 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:11 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:11 user nova-compute[72184]:   </clock>
Aug 01 16:52:11 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:11 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:11 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:11 user nova-compute[72184]:   </cpu>
Aug 01 16:52:11 user nova-compute[72184]:   <devices>
Aug 01 16:52:11 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:11 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:11 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk"/>
Aug 01 16:52:11 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:11 user nova-compute[72184]:     </disk>
Aug 01 16:52:11 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:11 user nova-compute[72184]:       <mac address="fa:16:3e:ec:c9:26"/>
Aug 01 16:52:11 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:11 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:11 user nova-compute[72184]:       <target dev="tap0f436652-34"/>
Aug 01 16:52:11 user nova-compute[72184]:     </interface>
Aug 01 16:52:11 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:11 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/console.log" append="off"/>
Aug 01 16:52:11 user nova-compute[72184]:     </serial>
Aug 01 16:52:11 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:11 user nova-compute[72184]:     <video>
Aug 01 16:52:11 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:11 user nova-compute[72184]:     </video>
Aug 01 16:52:11 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:11 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:11 user nova-compute[72184]:     </rng>
Aug 01 16:52:11 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:11 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:11 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:11 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:11 user nova-compute[72184]:   </devices>
Aug 01 16:52:11 user nova-compute[72184]: </domain>
Aug 01 16:52:11 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-623125351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-623125351',id=5,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqBQaHRmRQCVjgHiCHshJwLFnDOChFlAONZJtpK/iL6UO2w5TfdE+orrMFJTJwYeiLFxUppypnuUzUjUtQy+Mfbt8WhDUcbIQQl9rd5QartVEXEALGbanAD3iDGMaS+WA==',key_name='tempest-keypair-1293735261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-b16eyn80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=7b407b54-6887-4b20-a3ae-50a2ce5777be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG os_vif [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f436652-34, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f436652-34, col_values=(('external_ids', {'iface-id': '0f436652-34b6-45b4-bf2b-0eaea58addd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:c9:26', 'vm-uuid': '7b407b54-6887-4b20-a3ae-50a2ce5777be'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908731.3023267, 76785510-2f39-4b4f-a11c-d30f9cd82138 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] VM Resumed (Lifecycle Event)
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:11 user nova-compute[72184]: INFO os_vif [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34')
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Instance spawned successfully.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908731.3058202, 76785510-2f39-4b4f-a11c-d30f9cd82138 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] VM Started (Lifecycle Event)
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] No VIF found with MAC fa:16:3e:ec:c9:26, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Took 16.07 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Creating image(s)
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:11 user nova-compute[72184]: DEBUG nova.policy [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fde93855aff4cd7b32bca4e3a56380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba59b45c64bc4f50babadda186b3c8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:52:11 user nova-compute[72184]: INFO nova.compute.manager [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Took 17.00 seconds to build instance.
Aug 01 16:52:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-838eec3f-90b8-43a2-a8f3-e96e4c8e6938 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.130s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.221s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.222s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk 1073741824" returned: 0 in 0.082s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.205s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:12 user nova-compute[72184]: WARNING nova.compute.manager [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state building and task_state spawning.
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] No waiting events found dispatching network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:12 user nova-compute[72184]: WARNING nova.compute.manager [req-b08057f9-f528-43d4-98ab-16d31ff52ec5 req-864f2566-34f9-4188-9fc9-52e9de3b7ebc service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received unexpected event network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 for instance with vm_state building and task_state spawning.
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Cannot resize image /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'migration_context' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Ensure instance console log exists: /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908732.8187468, 75c3c16a-8768-4b24-8469-35b77664a71e => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:12 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Resumed (Lifecycle Event)
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:12 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance spawned successfully.
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:12 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance spawned successfully.
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:12 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:12 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908732.8265626, a8b17402-c090-4e22-8ca7-06df5361d20c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:12 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] VM Resumed (Lifecycle Event)
Aug 01 16:52:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Took 22.07 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908732.8273559, a8b17402-c090-4e22-8ca7-06df5361d20c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] VM Started (Lifecycle Event)
Aug 01 16:52:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Took 23.63 seconds to build instance.
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908732.8274415, 75c3c16a-8768-4b24-8469-35b77664a71e => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Started (Lifecycle Event)
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Took 21.12 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e95b0b9-70d4-4824-9ae0-34f1c3bd480d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.863s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908733.362276, 8d331546-ccb4-4794-b3b8-ef5049640db6 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] VM Resumed (Lifecycle Event)
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Instance spawned successfully.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908733.380633, 8d331546-ccb4-4794-b3b8-ef5049640db6 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] VM Started (Lifecycle Event)
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Took 22.04 seconds to build instance.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-641e82dd-4d30-4788-820b-e125e94e8d34 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.183s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Took 10.36 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:13 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-4c2b864d-8dfa-4882-9361-153ffed6932e req-0b51f615-6b1b-4d75-97fb-c152bc8a1019 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4c2b864d-8dfa-4882-9361-153ffed6932e req-0b51f615-6b1b-4d75-97fb-c152bc8a1019 service nova] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4c2b864d-8dfa-4882-9361-153ffed6932e req-0b51f615-6b1b-4d75-97fb-c152bc8a1019 service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4c2b864d-8dfa-4882-9361-153ffed6932e req-0b51f615-6b1b-4d75-97fb-c152bc8a1019 service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-4c2b864d-8dfa-4882-9361-153ffed6932e req-0b51f615-6b1b-4d75-97fb-c152bc8a1019 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] No waiting events found dispatching network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:13 user nova-compute[72184]: WARNING nova.compute.manager [req-4c2b864d-8dfa-4882-9361-153ffed6932e req-0b51f615-6b1b-4d75-97fb-c152bc8a1019 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received unexpected event network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 for instance with vm_state building and task_state spawning.
Aug 01 16:52:14 user nova-compute[72184]: INFO nova.compute.manager [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Took 12.09 seconds to build instance.
Aug 01 16:52:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e5135bf4-f089-4fde-a2e9-47c006a7c185 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.406s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-7aba402a-438a-4e5d-a43d-437dff2667d9 req-e9065d32-7eea-4cdd-ac3d-13a4c7743c92 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7aba402a-438a-4e5d-a43d-437dff2667d9 req-e9065d32-7eea-4cdd-ac3d-13a4c7743c92 service nova] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7aba402a-438a-4e5d-a43d-437dff2667d9 req-e9065d32-7eea-4cdd-ac3d-13a4c7743c92 service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7aba402a-438a-4e5d-a43d-437dff2667d9 req-e9065d32-7eea-4cdd-ac3d-13a4c7743c92 service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-7aba402a-438a-4e5d-a43d-437dff2667d9 req-e9065d32-7eea-4cdd-ac3d-13a4c7743c92 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] No waiting events found dispatching network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:14 user nova-compute[72184]: WARNING nova.compute.manager [req-7aba402a-438a-4e5d-a43d-437dff2667d9 req-e9065d32-7eea-4cdd-ac3d-13a4c7743c92 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received unexpected event network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 for instance with vm_state active and task_state None.
Aug 01 16:52:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:15 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Successfully created port: 2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd871dd0-a767-4f07-a287-07f19da26bce req-dbf09a5f-bcdc-4646-8deb-e9ae8ae7af2d service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd871dd0-a767-4f07-a287-07f19da26bce req-dbf09a5f-bcdc-4646-8deb-e9ae8ae7af2d service nova] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd871dd0-a767-4f07-a287-07f19da26bce req-dbf09a5f-bcdc-4646-8deb-e9ae8ae7af2d service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd871dd0-a767-4f07-a287-07f19da26bce req-dbf09a5f-bcdc-4646-8deb-e9ae8ae7af2d service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd871dd0-a767-4f07-a287-07f19da26bce req-dbf09a5f-bcdc-4646-8deb-e9ae8ae7af2d service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] No waiting events found dispatching network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:16 user nova-compute[72184]: WARNING nova.compute.manager [req-bd871dd0-a767-4f07-a287-07f19da26bce req-dbf09a5f-bcdc-4646-8deb-e9ae8ae7af2d service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received unexpected event network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 for instance with vm_state building and task_state spawning.
Aug 01 16:52:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908736.5884767, 7b407b54-6887-4b20-a3ae-50a2ce5777be => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] VM Resumed (Lifecycle Event)
Aug 01 16:52:16 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Instance spawned successfully.
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908736.5886228, 7b407b54-6887-4b20-a3ae-50a2ce5777be => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] VM Started (Lifecycle Event)
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:16 user nova-compute[72184]: INFO nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Took 14.61 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:17 user nova-compute[72184]: INFO nova.compute.manager [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Took 16.06 seconds to build instance.
Aug 01 16:52:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-acb4094b-ff29-4fe0-b4e8-b2110a0b929f tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.239s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Successfully updated port: 2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing instance network info cache due to event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance network_info: |[{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Start _get_guest_xml network_info=[{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-842643259',display_name='tempest-ServerStableDeviceRescueTest-server-842643259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-842643259',id=7,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIohFOUjcgbCcEJVHNMMVKdtDg/iJ7UD6loeqFDRoqcofm/E/mwfo4ZcHkSNKUtSw7ZiWLoK7zIV1QA46aomYsQO7Yf5OX1J9BUKLKSkNxkKQyisbBwt6FItJj+GMp58Cg==',key_name='tempest-keypair-1152278047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba59b45c64bc4f50babadda186b3c8ac',ramdisk_id='',reservation_id='r-vrl7515u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-245198057',owner_user_name='tempest-ServerStableDeviceRescueTest-245198057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fde93855aff4cd7b32bca4e3a56380e',uuid=a70ead3f-68f7-4be2-acbd-b5b4f6501a54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converting VIF {"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'pci_devices' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:20 user nova-compute[72184]:   <uuid>a70ead3f-68f7-4be2-acbd-b5b4f6501a54</uuid>
Aug 01 16:52:20 user nova-compute[72184]:   <name>instance-00000007</name>
Aug 01 16:52:20 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:20 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:20 user nova-compute[72184]:   <metadata>
Aug 01 16:52:20 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:20 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:20 user nova-compute[72184]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-842643259</nova:name>
Aug 01 16:52:20 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:20</nova:creationTime>
Aug 01 16:52:20 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:20 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:20 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:20 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:user uuid="2fde93855aff4cd7b32bca4e3a56380e">tempest-ServerStableDeviceRescueTest-245198057-project-member</nova:user>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:project uuid="ba59b45c64bc4f50babadda186b3c8ac">tempest-ServerStableDeviceRescueTest-245198057</nova:project>
Aug 01 16:52:20 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:20 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:20 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:20 user nova-compute[72184]:         <nova:port uuid="2d8ec797-0e9e-4016-983f-aca7420380b2">
Aug 01 16:52:20 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 16:52:20 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:20 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:20 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:20 user nova-compute[72184]:   </metadata>
Aug 01 16:52:20 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:20 user nova-compute[72184]:     <system>
Aug 01 16:52:20 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:20 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:20 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:20 user nova-compute[72184]:       <entry name="serial">a70ead3f-68f7-4be2-acbd-b5b4f6501a54</entry>
Aug 01 16:52:20 user nova-compute[72184]:       <entry name="uuid">a70ead3f-68f7-4be2-acbd-b5b4f6501a54</entry>
Aug 01 16:52:20 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:20 user nova-compute[72184]:     </system>
Aug 01 16:52:20 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:20 user nova-compute[72184]:   <os>
Aug 01 16:52:20 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:20 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:20 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:20 user nova-compute[72184]:   </os>
Aug 01 16:52:20 user nova-compute[72184]:   <features>
Aug 01 16:52:20 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:20 user nova-compute[72184]:     <apic/>
Aug 01 16:52:20 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:20 user nova-compute[72184]:   </features>
Aug 01 16:52:20 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:20 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:20 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:20 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:20 user nova-compute[72184]:   </clock>
Aug 01 16:52:20 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:20 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:20 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:20 user nova-compute[72184]:   </cpu>
Aug 01 16:52:20 user nova-compute[72184]:   <devices>
Aug 01 16:52:20 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:20 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:20 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk"/>
Aug 01 16:52:20 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:20 user nova-compute[72184]:     </disk>
Aug 01 16:52:20 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:20 user nova-compute[72184]:       <mac address="fa:16:3e:bc:88:b2"/>
Aug 01 16:52:20 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:20 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:20 user nova-compute[72184]:       <target dev="tap2d8ec797-0e"/>
Aug 01 16:52:20 user nova-compute[72184]:     </interface>
Aug 01 16:52:20 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:20 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/console.log" append="off"/>
Aug 01 16:52:20 user nova-compute[72184]:     </serial>
Aug 01 16:52:20 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:20 user nova-compute[72184]:     <video>
Aug 01 16:52:20 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:20 user nova-compute[72184]:     </video>
Aug 01 16:52:20 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:20 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:20 user nova-compute[72184]:     </rng>
Aug 01 16:52:20 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:20 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:20 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:20 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:20 user nova-compute[72184]:   </devices>
Aug 01 16:52:20 user nova-compute[72184]: </domain>
Aug 01 16:52:20 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-842643259',display_name='tempest-ServerStableDeviceRescueTest-server-842643259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-842643259',id=7,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIohFOUjcgbCcEJVHNMMVKdtDg/iJ7UD6loeqFDRoqcofm/E/mwfo4ZcHkSNKUtSw7ZiWLoK7zIV1QA46aomYsQO7Yf5OX1J9BUKLKSkNxkKQyisbBwt6FItJj+GMp58Cg==',key_name='tempest-keypair-1152278047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba59b45c64bc4f50babadda186b3c8ac',ramdisk_id='',reservation_id='r-vrl7515u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-245198057',owner_user_name='tempest-ServerStableDeviceRescueTest-245198057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fde93855aff4cd7b32bca4e3a56380e',uuid=a70ead3f-68f7-4be2-acbd-b5b4f6501a54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converting VIF {"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG os_vif [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d8ec797-0e, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d8ec797-0e, col_values=(('external_ids', {'iface-id': '2d8ec797-0e9e-4016-983f-aca7420380b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:88:b2', 'vm-uuid': 'a70ead3f-68f7-4be2-acbd-b5b4f6501a54'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:20 user nova-compute[72184]: INFO os_vif [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e')
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No VIF found with MAC fa:16:3e:bc:88:b2, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG nova.network.neutron [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updated VIF entry in instance network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG nova.network.neutron [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5dace0c6-bd01-4cad-bd65-1f0f5feb638a req-8db97124-f361-4350-a9e7-fe63e1271a74 service nova] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-15c0c75b-3a6e-409b-b547-a405584efad8 req-e2844b1b-ee51-4083-b82a-1d19be94e9d9 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15c0c75b-3a6e-409b-b547-a405584efad8 req-e2844b1b-ee51-4083-b82a-1d19be94e9d9 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15c0c75b-3a6e-409b-b547-a405584efad8 req-e2844b1b-ee51-4083-b82a-1d19be94e9d9 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15c0c75b-3a6e-409b-b547-a405584efad8 req-e2844b1b-ee51-4083-b82a-1d19be94e9d9 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-15c0c75b-3a6e-409b-b547-a405584efad8 req-e2844b1b-ee51-4083-b82a-1d19be94e9d9 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:23 user nova-compute[72184]: WARNING nova.compute.manager [req-15c0c75b-3a6e-409b-b547-a405584efad8 req-e2844b1b-ee51-4083-b82a-1d19be94e9d9 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state building and task_state spawning.
Aug 01 16:52:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-47f6fd8c-d6ea-4508-ad92-f9e0301e4943 req-42d08d53-27e4-46d7-bee2-c47a13cd8e4f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-47f6fd8c-d6ea-4508-ad92-f9e0301e4943 req-42d08d53-27e4-46d7-bee2-c47a13cd8e4f service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-47f6fd8c-d6ea-4508-ad92-f9e0301e4943 req-42d08d53-27e4-46d7-bee2-c47a13cd8e4f service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-47f6fd8c-d6ea-4508-ad92-f9e0301e4943 req-42d08d53-27e4-46d7-bee2-c47a13cd8e4f service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-47f6fd8c-d6ea-4508-ad92-f9e0301e4943 req-42d08d53-27e4-46d7-bee2-c47a13cd8e4f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:25 user nova-compute[72184]: WARNING nova.compute.manager [req-47f6fd8c-d6ea-4508-ad92-f9e0301e4943 req-42d08d53-27e4-46d7-bee2-c47a13cd8e4f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state building and task_state spawning.
Aug 01 16:52:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908746.2136316, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Resumed (Lifecycle Event)
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance spawned successfully.
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.claims [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Claim successful on node user
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908746.2144475, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Started (Lifecycle Event)
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Took 14.67 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:26 user nova-compute[72184]: INFO nova.compute.manager [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Took 16.27 seconds to build instance.
Aug 01 16:52:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9da4108d-28db-4158-adf4-43c13b4330f9 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.410s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.808s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:52:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.policy [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a36b28188247476b9b2f08c735a9089c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25e02b908e24e88b6ab9e0b86fdc699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:52:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Creating image(s)
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "/opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "/opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "/opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.233s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk 1073741824" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:52:28 user nova-compute[72184]: INFO nova.compute.claims [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Claim successful on node user
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Successfully created port: 36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Cannot resize image /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.objects.instance [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'migration_context' on Instance uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Ensure instance console log exists: /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.network.neutron [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:52:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.policy [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87601f29198d46f59297c49d288cdee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534dff85f9514a65965377871103e1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:52:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Creating image(s)
Aug 01 16:52:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "/opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "/opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "01a809fb45a66775fee8d0845f3c92d15acce4dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "01a809fb45a66775fee8d0845f3c92d15acce4dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:29 user nova-compute[72184]: DEBUG nova.network.neutron [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Successfully updated port: 36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquired lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-changed-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Refreshing instance network info cache due to event network-changed-36c18de7-3c3e-4a20-b6da-1916d8e12323. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] Acquiring lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.part --force-share --output=json" returned: 0 in 0.278s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.images [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] e110e3b1-80fa-4bb0-8638-513de5f6a8ed was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.part /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.part /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.converted" returned: 0 in 0.353s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updating instance_info_cache with network_info: [{"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Successfully created port: 161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Releasing lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Instance network_info: |[{"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] Acquired lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Refreshing network info cache for port 36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Start _get_guest_xml network_info=[{"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:31 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:31 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1938253671',display_name='tempest-VolumesAdminNegativeTest-server-1938253671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1938253671',id=8,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRUmRcoanGo2ErsLnnB/e9dm/Uw4paBCn/BDiUKLlcd0L9GHnx7lJXTyKVT0cJwFZ1a9sz8cSyIZGsa642sC9RpZDs3e8IPiMIju0meTHvfE4aPBxYFnWsjrUNYcNGyNA==',key_name='tempest-keypair-1814341886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b25e02b908e24e88b6ab9e0b86fdc699',ramdisk_id='',reservation_id='r-aq8gsu6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1181939340',owner_user_name='tempest-VolumesAdminNegativeTest-1181939340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a36b28188247476b9b2f08c735a9089c',uuid=70e188c4-72bc-4842-bb3f-a9d611c38164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converting VIF {"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG nova.objects.instance [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'pci_devices' on Instance uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd.converted --force-share --output=json" returned: 0 in 0.254s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "01a809fb45a66775fee8d0845f3c92d15acce4dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.124s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:32 user nova-compute[72184]:   <uuid>70e188c4-72bc-4842-bb3f-a9d611c38164</uuid>
Aug 01 16:52:32 user nova-compute[72184]:   <name>instance-00000008</name>
Aug 01 16:52:32 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:32 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:32 user nova-compute[72184]:   <metadata>
Aug 01 16:52:32 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:32 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:32 user nova-compute[72184]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1938253671</nova:name>
Aug 01 16:52:32 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:31</nova:creationTime>
Aug 01 16:52:32 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:32 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:32 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:32 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:user uuid="a36b28188247476b9b2f08c735a9089c">tempest-VolumesAdminNegativeTest-1181939340-project-member</nova:user>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:project uuid="b25e02b908e24e88b6ab9e0b86fdc699">tempest-VolumesAdminNegativeTest-1181939340</nova:project>
Aug 01 16:52:32 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:32 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:32 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:32 user nova-compute[72184]:         <nova:port uuid="36c18de7-3c3e-4a20-b6da-1916d8e12323">
Aug 01 16:52:32 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 16:52:32 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:32 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:32 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:32 user nova-compute[72184]:   </metadata>
Aug 01 16:52:32 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:32 user nova-compute[72184]:     <system>
Aug 01 16:52:32 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:32 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:32 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:32 user nova-compute[72184]:       <entry name="serial">70e188c4-72bc-4842-bb3f-a9d611c38164</entry>
Aug 01 16:52:32 user nova-compute[72184]:       <entry name="uuid">70e188c4-72bc-4842-bb3f-a9d611c38164</entry>
Aug 01 16:52:32 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:32 user nova-compute[72184]:     </system>
Aug 01 16:52:32 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:32 user nova-compute[72184]:   <os>
Aug 01 16:52:32 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:32 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:32 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:32 user nova-compute[72184]:   </os>
Aug 01 16:52:32 user nova-compute[72184]:   <features>
Aug 01 16:52:32 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:32 user nova-compute[72184]:     <apic/>
Aug 01 16:52:32 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:32 user nova-compute[72184]:   </features>
Aug 01 16:52:32 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:32 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:32 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:32 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:32 user nova-compute[72184]:   </clock>
Aug 01 16:52:32 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:32 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:32 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:32 user nova-compute[72184]:   </cpu>
Aug 01 16:52:32 user nova-compute[72184]:   <devices>
Aug 01 16:52:32 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:32 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:32 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk"/>
Aug 01 16:52:32 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:32 user nova-compute[72184]:     </disk>
Aug 01 16:52:32 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:32 user nova-compute[72184]:       <mac address="fa:16:3e:3a:4a:d9"/>
Aug 01 16:52:32 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:32 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:32 user nova-compute[72184]:       <target dev="tap36c18de7-3c"/>
Aug 01 16:52:32 user nova-compute[72184]:     </interface>
Aug 01 16:52:32 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:32 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/console.log" append="off"/>
Aug 01 16:52:32 user nova-compute[72184]:     </serial>
Aug 01 16:52:32 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:32 user nova-compute[72184]:     <video>
Aug 01 16:52:32 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:32 user nova-compute[72184]:     </video>
Aug 01 16:52:32 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:32 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:32 user nova-compute[72184]:     </rng>
Aug 01 16:52:32 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:32 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:32 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:32 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:32 user nova-compute[72184]:   </devices>
Aug 01 16:52:32 user nova-compute[72184]: </domain>
Aug 01 16:52:32 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1938253671',display_name='tempest-VolumesAdminNegativeTest-server-1938253671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1938253671',id=8,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRUmRcoanGo2ErsLnnB/e9dm/Uw4paBCn/BDiUKLlcd0L9GHnx7lJXTyKVT0cJwFZ1a9sz8cSyIZGsa642sC9RpZDs3e8IPiMIju0meTHvfE4aPBxYFnWsjrUNYcNGyNA==',key_name='tempest-keypair-1814341886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b25e02b908e24e88b6ab9e0b86fdc699',ramdisk_id='',reservation_id='r-aq8gsu6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1181939340',owner_user_name='tempest-VolumesAdminNegativeTest-1181939340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a36b28188247476b9b2f08c735a9089c',uuid=70e188c4-72bc-4842-bb3f-a9d611c38164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converting VIF {"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG os_vif [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36c18de7-3c, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36c18de7-3c, col_values=(('external_ids', {'iface-id': '36c18de7-3c3e-4a20-b6da-1916d8e12323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4a:d9', 'vm-uuid': '70e188c4-72bc-4842-bb3f-a9d611c38164'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:32 user nova-compute[72184]: INFO os_vif [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c')
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "01a809fb45a66775fee8d0845f3c92d15acce4dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "01a809fb45a66775fee8d0845f3c92d15acce4dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No VIF found with MAC fa:16:3e:3a:4a:d9, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd --force-share --output=json" returned: 0 in 0.293s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd,backing_fmt=raw /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd,backing_fmt=raw /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk 1073741824" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "01a809fb45a66775fee8d0845f3c92d15acce4dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.441s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updated VIF entry in instance network info cache for port 36c18de7-3c3e-4a20-b6da-1916d8e12323. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updating instance_info_cache with network_info: [{"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd --force-share --output=json" returned: 0 in 0.251s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-38c9ef96-8694-4eb0-b64a-741840961099 req-1170cc4e-654e-4e1f-9e46-e8d884ba802f service nova] Releasing lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Cannot resize image /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lazy-loading 'migration_context' on Instance uuid 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Ensure instance console log exists: /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Successfully updated port: 161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquired lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-changed-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Refreshing instance network info cache due to event network-changed-161ebe17-3cae-4663-885d-2fa0cee0f8d8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] Acquiring lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updating instance_info_cache with network_info: [{"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Releasing lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Instance network_info: |[{"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] Acquired lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.neutron [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Refreshing network info cache for port 161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Start _get_guest_xml network_info=[{"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:52:18Z,direct_url=<?>,disk_format='qcow2',id=e110e3b1-80fa-4bb0-8638-513de5f6a8ed,min_disk=0,min_ram=0,name='',owner='9ec259ce1d7545c7a20423c2cdad0c55',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:52:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'e110e3b1-80fa-4bb0-8638-513de5f6a8ed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:33 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:33 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:52:18Z,direct_url=<?>,disk_format='qcow2',id=e110e3b1-80fa-4bb0-8638-513de5f6a8ed,min_disk=0,min_ram=0,name='',owner='9ec259ce1d7545c7a20423c2cdad0c55',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:52:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1098537382',display_name='tempest-AttachSCSIVolumeTestJSON-server-1098537382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1098537382',id=9,image_ref='e110e3b1-80fa-4bb0-8638-513de5f6a8ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOC72tup+DCAJHhoHmArMLchyNAqdnzgqUeMw7GHPmQil1Yn5zVOweMzgKthv0iQ7AQ8oSOmqrpU7vA+6NcTwtrrAkSZ9miMpkRFi+BYH7O/bs6aZxfiWnQeyEiLPFsNQ==',key_name='tempest-keypair-1696491998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='534dff85f9514a65965377871103e1e4',ramdisk_id='',reservation_id='r-oyfkqbpq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e110e3b1-80fa-4bb0-8638-513de5f6a8ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-135251302',owner_user_name='tempest-AttachSCSIVolumeTestJSON-135251302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87601f29198d46f59297c49d288cdee0',uuid=7e039a15-ad7b-4667-b0fb-002c6d9b4ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Converting VIF {"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:33 user nova-compute[72184]:   <uuid>7e039a15-ad7b-4667-b0fb-002c6d9b4ab0</uuid>
Aug 01 16:52:33 user nova-compute[72184]:   <name>instance-00000009</name>
Aug 01 16:52:33 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:33 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:33 user nova-compute[72184]:   <metadata>
Aug 01 16:52:33 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:33 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:33 user nova-compute[72184]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1098537382</nova:name>
Aug 01 16:52:33 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:33</nova:creationTime>
Aug 01 16:52:33 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:33 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:33 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:33 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:user uuid="87601f29198d46f59297c49d288cdee0">tempest-AttachSCSIVolumeTestJSON-135251302-project-member</nova:user>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:project uuid="534dff85f9514a65965377871103e1e4">tempest-AttachSCSIVolumeTestJSON-135251302</nova:project>
Aug 01 16:52:33 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:33 user nova-compute[72184]:       <nova:root type="image" uuid="e110e3b1-80fa-4bb0-8638-513de5f6a8ed"/>
Aug 01 16:52:33 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:33 user nova-compute[72184]:         <nova:port uuid="161ebe17-3cae-4663-885d-2fa0cee0f8d8">
Aug 01 16:52:33 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 16:52:33 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:33 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:33 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:33 user nova-compute[72184]:   </metadata>
Aug 01 16:52:33 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:33 user nova-compute[72184]:     <system>
Aug 01 16:52:33 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:33 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:33 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:33 user nova-compute[72184]:       <entry name="serial">7e039a15-ad7b-4667-b0fb-002c6d9b4ab0</entry>
Aug 01 16:52:33 user nova-compute[72184]:       <entry name="uuid">7e039a15-ad7b-4667-b0fb-002c6d9b4ab0</entry>
Aug 01 16:52:33 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:33 user nova-compute[72184]:     </system>
Aug 01 16:52:33 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:33 user nova-compute[72184]:   <os>
Aug 01 16:52:33 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:33 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:33 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:33 user nova-compute[72184]:   </os>
Aug 01 16:52:33 user nova-compute[72184]:   <features>
Aug 01 16:52:33 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:33 user nova-compute[72184]:     <apic/>
Aug 01 16:52:33 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:33 user nova-compute[72184]:   </features>
Aug 01 16:52:33 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:33 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:33 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:33 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:33 user nova-compute[72184]:   </clock>
Aug 01 16:52:33 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:33 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:33 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:33 user nova-compute[72184]:   </cpu>
Aug 01 16:52:33 user nova-compute[72184]:   <devices>
Aug 01 16:52:33 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:33 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:33 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk"/>
Aug 01 16:52:33 user nova-compute[72184]:       <target dev="sda" bus="scsi"/>
Aug 01 16:52:33 user nova-compute[72184]:       <address type="drive" controller="0" unit="0"/>
Aug 01 16:52:33 user nova-compute[72184]:     </disk>
Aug 01 16:52:33 user nova-compute[72184]:     <disk type="file" device="cdrom">
Aug 01 16:52:33 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 16:52:33 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.config"/>
Aug 01 16:52:33 user nova-compute[72184]:       <target dev="sdb" bus="scsi"/>
Aug 01 16:52:33 user nova-compute[72184]:       <address type="drive" controller="0" unit="1"/>
Aug 01 16:52:33 user nova-compute[72184]:     </disk>
Aug 01 16:52:33 user nova-compute[72184]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 16:52:33 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:33 user nova-compute[72184]:       <mac address="fa:16:3e:c4:db:49"/>
Aug 01 16:52:33 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:33 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:33 user nova-compute[72184]:       <target dev="tap161ebe17-3c"/>
Aug 01 16:52:33 user nova-compute[72184]:     </interface>
Aug 01 16:52:33 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:33 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/console.log" append="off"/>
Aug 01 16:52:33 user nova-compute[72184]:     </serial>
Aug 01 16:52:33 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:33 user nova-compute[72184]:     <video>
Aug 01 16:52:33 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:33 user nova-compute[72184]:     </video>
Aug 01 16:52:33 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:33 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:33 user nova-compute[72184]:     </rng>
Aug 01 16:52:33 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:33 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:33 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:33 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:33 user nova-compute[72184]:   </devices>
Aug 01 16:52:33 user nova-compute[72184]: </domain>
Aug 01 16:52:33 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1098537382',display_name='tempest-AttachSCSIVolumeTestJSON-server-1098537382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1098537382',id=9,image_ref='e110e3b1-80fa-4bb0-8638-513de5f6a8ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOC72tup+DCAJHhoHmArMLchyNAqdnzgqUeMw7GHPmQil1Yn5zVOweMzgKthv0iQ7AQ8oSOmqrpU7vA+6NcTwtrrAkSZ9miMpkRFi+BYH7O/bs6aZxfiWnQeyEiLPFsNQ==',key_name='tempest-keypair-1696491998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='534dff85f9514a65965377871103e1e4',ramdisk_id='',reservation_id='r-oyfkqbpq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e110e3b1-80fa-4bb0-8638-513de5f6a8ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-135251302',owner_user_name='tempest-AttachSCSIVolumeTestJSON-135251302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87601f29198d46f59297c49d288cdee0',uuid=7e039a15-ad7b-4667-b0fb-002c6d9b4ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Converting VIF {"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG os_vif [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap161ebe17-3c, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap161ebe17-3c, col_values=(('external_ids', {'iface-id': '161ebe17-3cae-4663-885d-2fa0cee0f8d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:db:49', 'vm-uuid': '7e039a15-ad7b-4667-b0fb-002c6d9b4ab0'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:33 user nova-compute[72184]: INFO os_vif [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c')
Aug 01 16:52:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No BDM found with device name sda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No VIF found with MAC fa:16:3e:c4:db:49, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Using config drive
Aug 01 16:52:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Creating config drive at /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.config
Aug 01 16:52:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqfthh4up {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-3828a97d-0887-49e7-a5fa-920492237a2c req-77eec3fb-9f82-47e3-92b3-ea0f82ccf7ee service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3828a97d-0887-49e7-a5fa-920492237a2c req-77eec3fb-9f82-47e3-92b3-ea0f82ccf7ee service nova] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3828a97d-0887-49e7-a5fa-920492237a2c req-77eec3fb-9f82-47e3-92b3-ea0f82ccf7ee service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3828a97d-0887-49e7-a5fa-920492237a2c req-77eec3fb-9f82-47e3-92b3-ea0f82ccf7ee service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-3828a97d-0887-49e7-a5fa-920492237a2c req-77eec3fb-9f82-47e3-92b3-ea0f82ccf7ee service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] No waiting events found dispatching network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:34 user nova-compute[72184]: WARNING nova.compute.manager [req-3828a97d-0887-49e7-a5fa-920492237a2c req-77eec3fb-9f82-47e3-92b3-ea0f82ccf7ee service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received unexpected event network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 for instance with vm_state building and task_state spawning.
Aug 01 16:52:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqfthh4up" returned: 0 in 0.086s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updated VIF entry in instance network info cache for port 161ebe17-3cae-4663-885d-2fa0cee0f8d8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updating instance_info_cache with network_info: [{"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9309223d-d705-4d3c-9232-2aff8c04281a req-1a385200-93d2-452e-97f8-005af150b09e service nova] Releasing lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:52:36 user nova-compute[72184]: INFO nova.compute.claims [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Claim successful on node user
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] No waiting events found dispatching network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:36 user nova-compute[72184]: WARNING nova.compute.manager [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received unexpected event network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 for instance with vm_state building and task_state spawning.
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] No waiting events found dispatching network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:36 user nova-compute[72184]: WARNING nova.compute.manager [req-9b1eb176-a5f9-4ae0-8bc5-2566c7c320ae req-d743d1a6-c070-43e0-b393-7d20341de753 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received unexpected event network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 for instance with vm_state building and task_state spawning.
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:52:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.policy [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630b2eb8d9dd459d818f2ea96163609c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99be24c2573f410e81daf0409829fdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:52:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Creating image(s)
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "/opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "/opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "/opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk 1073741824" returned: 0 in 0.051s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:52:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Cannot resize image /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lazy-loading 'migration_context' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Successfully created port: 5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Ensure instance console log exists: /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908758.4256032, 70e188c4-72bc-4842-bb3f-a9d611c38164 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] VM Resumed (Lifecycle Event)
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Instance spawned successfully.
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908758.4271894, 70e188c4-72bc-4842-bb3f-a9d611c38164 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] VM Started (Lifecycle Event)
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Took 11.03 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-8bbf34f7-4109-4485-be07-e44ca3256b38 req-f3e19e39-7341-445d-99f8-1312df3a309a service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8bbf34f7-4109-4485-be07-e44ca3256b38 req-f3e19e39-7341-445d-99f8-1312df3a309a service nova] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8bbf34f7-4109-4485-be07-e44ca3256b38 req-f3e19e39-7341-445d-99f8-1312df3a309a service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8bbf34f7-4109-4485-be07-e44ca3256b38 req-f3e19e39-7341-445d-99f8-1312df3a309a service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-8bbf34f7-4109-4485-be07-e44ca3256b38 req-f3e19e39-7341-445d-99f8-1312df3a309a service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] No waiting events found dispatching network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:38 user nova-compute[72184]: WARNING nova.compute.manager [req-8bbf34f7-4109-4485-be07-e44ca3256b38 req-f3e19e39-7341-445d-99f8-1312df3a309a service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received unexpected event network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 for instance with vm_state building and task_state spawning.
Aug 01 16:52:38 user nova-compute[72184]: INFO nova.compute.manager [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Took 12.52 seconds to build instance.
Aug 01 16:52:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5b2d4300-5580-4047-9853-11e1887c01ad tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.683s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908759.0943747, 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] VM Resumed (Lifecycle Event)
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Instance spawned successfully.
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908759.0946753, 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] VM Started (Lifecycle Event)
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Took 9.45 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:39 user nova-compute[72184]: INFO nova.compute.manager [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Took 10.88 seconds to build instance.
Aug 01 16:52:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aad9c86c-f850-4661-91fe-513d51d99e48 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.212s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Successfully updated port: 5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-changed-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Refreshing instance network info cache due to event network-changed-5142ef5e-1637-4384-ac99-cd294cbeceb0. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] Acquiring lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] Acquired lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Refreshing network info cache for port 5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ae307e36-8914-4ae1-912b-c96aaf58999b req-f30ed50a-cf9e-4824-9bd0-3d9e91e1421f service nova] Releasing lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquired lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Updating instance_info_cache with network_info: [{"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Releasing lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Instance network_info: |[{"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Start _get_guest_xml network_info=[{"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:52:40 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:40 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1875124576',display_name='tempest-TestVolumeSwap-server-1875124576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1875124576',id=10,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITshTlth8Bg5Q5jF4LZ2fPOyV7MrdS7MyvzA4Kb0gmDcCWACK00n3205/N0JOX8XaDmHyhp1BOBTUxb+YCiQUuo24Vhc1bkZrUEhO+WeEakNZxqHng4+3n9biOiJbz54Q==',key_name='tempest-keypair-1833002847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99be24c2573f410e81daf0409829fdb7',ramdisk_id='',reservation_id='r-x8apcg0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1156395630',owner_user_name='tempest-TestVolumeSwap-1156395630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='630b2eb8d9dd459d818f2ea96163609c',uuid=7896ab2a-6313-459a-b5b9-916929f96970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Converting VIF {"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lazy-loading 'pci_devices' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:52:40 user nova-compute[72184]:   <uuid>7896ab2a-6313-459a-b5b9-916929f96970</uuid>
Aug 01 16:52:40 user nova-compute[72184]:   <name>instance-0000000a</name>
Aug 01 16:52:40 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:52:40 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:52:40 user nova-compute[72184]:   <metadata>
Aug 01 16:52:40 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:52:40 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:52:40 user nova-compute[72184]:       <nova:name>tempest-TestVolumeSwap-server-1875124576</nova:name>
Aug 01 16:52:40 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:52:40</nova:creationTime>
Aug 01 16:52:40 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:52:40 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:52:40 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:52:40 user nova-compute[72184]:       <nova:owner>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:user uuid="630b2eb8d9dd459d818f2ea96163609c">tempest-TestVolumeSwap-1156395630-project-member</nova:user>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:project uuid="99be24c2573f410e81daf0409829fdb7">tempest-TestVolumeSwap-1156395630</nova:project>
Aug 01 16:52:40 user nova-compute[72184]:       </nova:owner>
Aug 01 16:52:40 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:52:40 user nova-compute[72184]:       <nova:ports>
Aug 01 16:52:40 user nova-compute[72184]:         <nova:port uuid="5142ef5e-1637-4384-ac99-cd294cbeceb0">
Aug 01 16:52:40 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 16:52:40 user nova-compute[72184]:         </nova:port>
Aug 01 16:52:40 user nova-compute[72184]:       </nova:ports>
Aug 01 16:52:40 user nova-compute[72184]:     </nova:instance>
Aug 01 16:52:40 user nova-compute[72184]:   </metadata>
Aug 01 16:52:40 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:52:40 user nova-compute[72184]:     <system>
Aug 01 16:52:40 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:52:40 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:52:40 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:52:40 user nova-compute[72184]:       <entry name="serial">7896ab2a-6313-459a-b5b9-916929f96970</entry>
Aug 01 16:52:40 user nova-compute[72184]:       <entry name="uuid">7896ab2a-6313-459a-b5b9-916929f96970</entry>
Aug 01 16:52:40 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:52:40 user nova-compute[72184]:     </system>
Aug 01 16:52:40 user nova-compute[72184]:   </sysinfo>
Aug 01 16:52:40 user nova-compute[72184]:   <os>
Aug 01 16:52:40 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:52:40 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:52:40 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:52:40 user nova-compute[72184]:   </os>
Aug 01 16:52:40 user nova-compute[72184]:   <features>
Aug 01 16:52:40 user nova-compute[72184]:     <acpi/>
Aug 01 16:52:40 user nova-compute[72184]:     <apic/>
Aug 01 16:52:40 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:52:40 user nova-compute[72184]:   </features>
Aug 01 16:52:40 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:52:40 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:52:40 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:52:40 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:52:40 user nova-compute[72184]:   </clock>
Aug 01 16:52:40 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:52:40 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:52:40 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:52:40 user nova-compute[72184]:   </cpu>
Aug 01 16:52:40 user nova-compute[72184]:   <devices>
Aug 01 16:52:40 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:52:40 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:52:40 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk"/>
Aug 01 16:52:40 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:52:40 user nova-compute[72184]:     </disk>
Aug 01 16:52:40 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:52:40 user nova-compute[72184]:       <mac address="fa:16:3e:79:43:32"/>
Aug 01 16:52:40 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:40 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:52:40 user nova-compute[72184]:       <target dev="tap5142ef5e-16"/>
Aug 01 16:52:40 user nova-compute[72184]:     </interface>
Aug 01 16:52:40 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:52:40 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/console.log" append="off"/>
Aug 01 16:52:40 user nova-compute[72184]:     </serial>
Aug 01 16:52:40 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:52:40 user nova-compute[72184]:     <video>
Aug 01 16:52:40 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:52:40 user nova-compute[72184]:     </video>
Aug 01 16:52:40 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:52:40 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:52:40 user nova-compute[72184]:     </rng>
Aug 01 16:52:40 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:52:40 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:52:40 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:52:40 user nova-compute[72184]:     </memballoon>
Aug 01 16:52:40 user nova-compute[72184]:   </devices>
Aug 01 16:52:40 user nova-compute[72184]: </domain>
Aug 01 16:52:40 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1875124576',display_name='tempest-TestVolumeSwap-server-1875124576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1875124576',id=10,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITshTlth8Bg5Q5jF4LZ2fPOyV7MrdS7MyvzA4Kb0gmDcCWACK00n3205/N0JOX8XaDmHyhp1BOBTUxb+YCiQUuo24Vhc1bkZrUEhO+WeEakNZxqHng4+3n9biOiJbz54Q==',key_name='tempest-keypair-1833002847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99be24c2573f410e81daf0409829fdb7',ramdisk_id='',reservation_id='r-x8apcg0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1156395630',owner_user_name='tempest-TestVolumeSwap-1156395630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='630b2eb8d9dd459d818f2ea96163609c',uuid=7896ab2a-6313-459a-b5b9-916929f96970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Converting VIF {"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG os_vif [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5142ef5e-16, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5142ef5e-16, col_values=(('external_ids', {'iface-id': '5142ef5e-1637-4384-ac99-cd294cbeceb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:43:32', 'vm-uuid': '7896ab2a-6313-459a-b5b9-916929f96970'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:52:40 user nova-compute[72184]: INFO os_vif [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16')
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:52:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] No VIF found with MAC fa:16:3e:79:43:32, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:52:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-c53a1dc7-c674-4d18-98bf-7cfdcac0cbd2 req-e05f4e36-bf11-4c23-9ab1-425197dc0fef service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c53a1dc7-c674-4d18-98bf-7cfdcac0cbd2 req-e05f4e36-bf11-4c23-9ab1-425197dc0fef service nova] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c53a1dc7-c674-4d18-98bf-7cfdcac0cbd2 req-e05f4e36-bf11-4c23-9ab1-425197dc0fef service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c53a1dc7-c674-4d18-98bf-7cfdcac0cbd2 req-e05f4e36-bf11-4c23-9ab1-425197dc0fef service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-c53a1dc7-c674-4d18-98bf-7cfdcac0cbd2 req-e05f4e36-bf11-4c23-9ab1-425197dc0fef service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] No waiting events found dispatching network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:42 user nova-compute[72184]: WARNING nova.compute.manager [req-c53a1dc7-c674-4d18-98bf-7cfdcac0cbd2 req-e05f4e36-bf11-4c23-9ab1-425197dc0fef service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received unexpected event network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 for instance with vm_state building and task_state spawning.
Aug 01 16:52:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-3e5fd599-a8d5-4408-8243-6f5e428d54a9 req-ed6c4886-3188-447f-aa29-fdc86171a37a service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:52:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3e5fd599-a8d5-4408-8243-6f5e428d54a9 req-ed6c4886-3188-447f-aa29-fdc86171a37a service nova] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3e5fd599-a8d5-4408-8243-6f5e428d54a9 req-ed6c4886-3188-447f-aa29-fdc86171a37a service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3e5fd599-a8d5-4408-8243-6f5e428d54a9 req-ed6c4886-3188-447f-aa29-fdc86171a37a service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-3e5fd599-a8d5-4408-8243-6f5e428d54a9 req-ed6c4886-3188-447f-aa29-fdc86171a37a service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] No waiting events found dispatching network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:52:44 user nova-compute[72184]: WARNING nova.compute.manager [req-3e5fd599-a8d5-4408-8243-6f5e428d54a9 req-ed6c4886-3188-447f-aa29-fdc86171a37a service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received unexpected event network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 for instance with vm_state building and task_state spawning.
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Skipping network cache update for instance because it is Building. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 202a214d-94fc-4748-a403-abdbc75a4157 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908765.4075513, 7896ab2a-6313-459a-b5b9-916929f96970 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] VM Resumed (Lifecycle Event)
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Instance spawned successfully.
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908765.4078572, 7896ab2a-6313-459a-b5b9-916929f96970 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] VM Started (Lifecycle Event)
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Took 8.14 seconds to spawn the instance on the hypervisor.
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:45 user nova-compute[72184]: INFO nova.compute.manager [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Took 9.41 seconds to build instance.
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a3b4c91-e967-464b-a9af-d72b4a5f0271 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.565s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updating instance_info_cache with network_info: [{"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:45 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:52:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:52:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=25.647830963134766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7b407b54-6887-4b20-a3ae-50a2ce5777be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 70e188c4-72bc-4842-bb3f-a9d611c38164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7896ab2a-6313-459a-b5b9-916929f96970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:52:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.897s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:52:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:52:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:52:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:52:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:53:18 user nova-compute[72184]: INFO nova.compute.claims [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Claim successful on node user
Aug 01 16:53:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:53:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:53:18 user nova-compute[72184]: INFO nova.virt.block_device [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Booting with volume 0d2a6236-79ce-423d-8e01-027acd743f15 at /dev/vda
Aug 01 16:53:18 user nova-compute[72184]: DEBUG nova.policy [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f439bc4e6d14fc9af440d9c86f48d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb864281a044721bd9fbf84d80c01b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:53:18 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:18 user nova-compute[72184]: INFO oslo.privsep.daemon [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpld6af3id/privsep.sock']
Aug 01 16:53:18 user sudo[83392]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpld6af3id/privsep.sock
Aug 01 16:53:18 user sudo[83392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 16:53:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully created port: 13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully created port: aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully created port: 358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:20 user sudo[83392]: pam_unix(sudo:session): session closed for user root
Aug 01 16:53:20 user nova-compute[72184]: INFO oslo.privsep.daemon [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Spawned new privsep daemon via rootwrap
Aug 01 16:53:20 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 16:53:20 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 16:53:20 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 16:53:20 user nova-compute[72184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83397
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7320c65-e67f-471f-8660-b8409dd1f7aa]: (2,) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[432b045f-ccf8-495d-8b62-c662c57af342]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:20 user nova-compute[72184]: WARNING os_brick.initiator.connectors.nvmeof [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150dd43-b353-46e7-9bcb-3a22398be4d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1924dc-cb60-4079-9b18-c62b12410c1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[124c7174-5ecc-427a-aff5-7644c6940102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:20 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:53:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb65862c-ef9d-459c-93be-dd46a7ac0627]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== get_connector_properties: return (2036ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:20 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating existing volume attachment record: 077346ea-6641-4bb2-83b9-15ca22362cf9 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:53:21 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully created port: ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:23 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully created port: ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: 13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-13d4efe4-5871-4e5f-b474-5df9ffb1339a. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG nova.network.neutron [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port 13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "04d3b87c-2cec-499c-9972-b99310f6751f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.network.neutron [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:53:25 user nova-compute[72184]: INFO nova.compute.claims [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Claim successful on node user
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.network.neutron [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cf9db38-0f2b-4013-8119-486fa89099b2 req-accd517d-f87b-4550-8e7d-4a8d9fd5713a service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:25 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: 3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.policy [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04e472c46a3b420f886e62afc4623893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fabda688874990bf8049f9bd5f0464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:53:25 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Creating image(s)
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "/opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "/opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "/opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk 1073741824" returned: 0 in 0.053s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Cannot resize image /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lazy-loading 'migration_context' on Instance uuid 04d3b87c-2cec-499c-9972-b99310f6751f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Ensure instance console log exists: /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Successfully created port: b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: 6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-3c99fc28-3863-4b6d-a7a2-d762e2e86538. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port 3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Successfully updated port: b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-6c582588-6620-4f3e-b7d9-1a87cdff3120. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port 6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "refresh_cache-04d3b87c-2cec-499c-9972-b99310f6751f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquired lock "refresh_cache-04d3b87c-2cec-499c-9972-b99310f6751f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-changed-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Refreshing instance network info cache due to event network-changed-b3159d0a-1dcb-493e-ab62-fdbdb069439b. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] Acquiring lock "refresh_cache-04d3b87c-2cec-499c-9972-b99310f6751f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15b63edd-26da-4f1b-a024-c0824d538573 req-3af2a641-20cd-4f2f-9e6b-feba72f8ced4 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Updating instance_info_cache with network_info: [{"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Releasing lock "refresh_cache-04d3b87c-2cec-499c-9972-b99310f6751f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Instance network_info: |[{"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] Acquired lock "refresh_cache-04d3b87c-2cec-499c-9972-b99310f6751f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Refreshing network info cache for port b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Start _get_guest_xml network_info=[{"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:53:27 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:27 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1325419929',display_name='tempest-VolumesActionsTest-instance-1325419929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1325419929',id=12,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fabda688874990bf8049f9bd5f0464',ramdisk_id='',reservation_id='r-gioibnkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1024961451',owner_user_name='tempest-VolumesActionsTest-1024961451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:26Z,user_data=None,user_id='04e472c46a3b420f886e62afc4623893',uuid=04d3b87c-2cec-499c-9972-b99310f6751f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Converting VIF {"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lazy-loading 'pci_devices' on Instance uuid 04d3b87c-2cec-499c-9972-b99310f6751f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:53:27 user nova-compute[72184]:   <uuid>04d3b87c-2cec-499c-9972-b99310f6751f</uuid>
Aug 01 16:53:27 user nova-compute[72184]:   <name>instance-0000000c</name>
Aug 01 16:53:27 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:53:27 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:53:27 user nova-compute[72184]:   <metadata>
Aug 01 16:53:27 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:53:27 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:53:27 user nova-compute[72184]:       <nova:name>tempest-VolumesActionsTest-instance-1325419929</nova:name>
Aug 01 16:53:27 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:53:27</nova:creationTime>
Aug 01 16:53:27 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:53:27 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:53:27 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:53:27 user nova-compute[72184]:       <nova:owner>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:user uuid="04e472c46a3b420f886e62afc4623893">tempest-VolumesActionsTest-1024961451-project-member</nova:user>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:project uuid="20fabda688874990bf8049f9bd5f0464">tempest-VolumesActionsTest-1024961451</nova:project>
Aug 01 16:53:27 user nova-compute[72184]:       </nova:owner>
Aug 01 16:53:27 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:53:27 user nova-compute[72184]:       <nova:ports>
Aug 01 16:53:27 user nova-compute[72184]:         <nova:port uuid="b3159d0a-1dcb-493e-ab62-fdbdb069439b">
Aug 01 16:53:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 16:53:27 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:27 user nova-compute[72184]:       </nova:ports>
Aug 01 16:53:27 user nova-compute[72184]:     </nova:instance>
Aug 01 16:53:27 user nova-compute[72184]:   </metadata>
Aug 01 16:53:27 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:53:27 user nova-compute[72184]:     <system>
Aug 01 16:53:27 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:53:27 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:53:27 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:53:27 user nova-compute[72184]:       <entry name="serial">04d3b87c-2cec-499c-9972-b99310f6751f</entry>
Aug 01 16:53:27 user nova-compute[72184]:       <entry name="uuid">04d3b87c-2cec-499c-9972-b99310f6751f</entry>
Aug 01 16:53:27 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:53:27 user nova-compute[72184]:     </system>
Aug 01 16:53:27 user nova-compute[72184]:   </sysinfo>
Aug 01 16:53:27 user nova-compute[72184]:   <os>
Aug 01 16:53:27 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:53:27 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:53:27 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:53:27 user nova-compute[72184]:   </os>
Aug 01 16:53:27 user nova-compute[72184]:   <features>
Aug 01 16:53:27 user nova-compute[72184]:     <acpi/>
Aug 01 16:53:27 user nova-compute[72184]:     <apic/>
Aug 01 16:53:27 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:53:27 user nova-compute[72184]:   </features>
Aug 01 16:53:27 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:53:27 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:53:27 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:53:27 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:53:27 user nova-compute[72184]:   </clock>
Aug 01 16:53:27 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:53:27 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:53:27 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:53:27 user nova-compute[72184]:   </cpu>
Aug 01 16:53:27 user nova-compute[72184]:   <devices>
Aug 01 16:53:27 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:53:27 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:53:27 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk"/>
Aug 01 16:53:27 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:53:27 user nova-compute[72184]:     </disk>
Aug 01 16:53:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:27 user nova-compute[72184]:       <mac address="fa:16:3e:f0:c5:20"/>
Aug 01 16:53:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:27 user nova-compute[72184]:       <target dev="tapb3159d0a-1d"/>
Aug 01 16:53:27 user nova-compute[72184]:     </interface>
Aug 01 16:53:27 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:53:27 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/console.log" append="off"/>
Aug 01 16:53:27 user nova-compute[72184]:     </serial>
Aug 01 16:53:27 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:53:27 user nova-compute[72184]:     <video>
Aug 01 16:53:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:27 user nova-compute[72184]:     </video>
Aug 01 16:53:27 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:53:27 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:53:27 user nova-compute[72184]:     </rng>
Aug 01 16:53:27 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:53:27 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:53:27 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:53:27 user nova-compute[72184]:     </memballoon>
Aug 01 16:53:27 user nova-compute[72184]:   </devices>
Aug 01 16:53:27 user nova-compute[72184]: </domain>
Aug 01 16:53:27 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1325419929',display_name='tempest-VolumesActionsTest-instance-1325419929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1325419929',id=12,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fabda688874990bf8049f9bd5f0464',ramdisk_id='',reservation_id='r-gioibnkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1024961451',owner_user_name='tempest-VolumesActionsTest-1024961451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:26Z,user_data=None,user_id='04e472c46a3b420f886e62afc4623893',uuid=04d3b87c-2cec-499c-9972-b99310f6751f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Converting VIF {"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG os_vif [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3159d0a-1d, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3159d0a-1d, col_values=(('external_ids', {'iface-id': 'b3159d0a-1dcb-493e-ab62-fdbdb069439b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:c5:20', 'vm-uuid': '04d3b87c-2cec-499c-9972-b99310f6751f'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:27 user nova-compute[72184]: INFO os_vif [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d')
Aug 01 16:53:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] No VIF found with MAC fa:16:3e:f0:c5:20, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Updated VIF entry in instance network info cache for port b3159d0a-1dcb-493e-ab62-fdbdb069439b. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Updating instance_info_cache with network_info: [{"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60c3de96-e0b6-45b8-aa7d-022e367f1b2b req-4289ef32-484d-45b3-9bda-a00c187ceff9 service nova] Releasing lock "refresh_cache-04d3b87c-2cec-499c-9972-b99310f6751f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: 358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:28 user nova-compute[72184]: INFO nova.virt.block_device [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Booting with volume 1fc1ced7-e7d1-482c-a958-bd43b92636c6 at /dev/vdb
Aug 01 16:53:28 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e5f45-1882-4587-841a-d8850357156b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83cbda1-6106-461f-b25c-32bc6e953ad6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6b4582-bf52-418b-9828-01173988907e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed26d5-f3e4-4cbb-b8c1-c92982df06aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:29 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae95c09-8e0d-489d-904c-249523654429]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating existing volume attachment record: 06bcba66-6a81-4c82-8f45-396eb812cb49 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-aafdad05-0ebd-466e-a2c0-9e41a431847e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-358d82a9-c685-43e5-9484-3762fd03d794. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port 358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-bb1cae0f-ca10-43fc-92cc-3ef9f22b6b1e req-32cc4727-ea3c-4af5-a915-c258e395b09b service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bb1cae0f-ca10-43fc-92cc-3ef9f22b6b1e req-32cc4727-ea3c-4af5-a915-c258e395b09b service nova] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bb1cae0f-ca10-43fc-92cc-3ef9f22b6b1e req-32cc4727-ea3c-4af5-a915-c258e395b09b service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bb1cae0f-ca10-43fc-92cc-3ef9f22b6b1e req-32cc4727-ea3c-4af5-a915-c258e395b09b service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-bb1cae0f-ca10-43fc-92cc-3ef9f22b6b1e req-32cc4727-ea3c-4af5-a915-c258e395b09b service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] No waiting events found dispatching network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:29 user nova-compute[72184]: WARNING nova.compute.manager [req-bb1cae0f-ca10-43fc-92cc-3ef9f22b6b1e req-32cc4727-ea3c-4af5-a915-c258e395b09b service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received unexpected event network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b for instance with vm_state building and task_state spawning.
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5fdabeda-8b0f-40e9-9a74-2bc9d92719f1 req-08af88e3-24de-4198-aa7a-abaac50a45a7 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Successfully updated port: ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:53:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-ccf96acb-280b-46df-ab5a-535ed5b54a83. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908811.6220634, 04d3b87c-2cec-499c-9972-b99310f6751f => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] VM Resumed (Lifecycle Event)
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Instance spawned successfully.
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908811.6265385, 04d3b87c-2cec-499c-9972-b99310f6751f => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] VM Started (Lifecycle Event)
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-4460d465-cc97-4fd1-b2fa-ef25317fe543 req-0fe340a9-8c2f-49b2-814d-12dd61837786 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4460d465-cc97-4fd1-b2fa-ef25317fe543 req-0fe340a9-8c2f-49b2-814d-12dd61837786 service nova] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4460d465-cc97-4fd1-b2fa-ef25317fe543 req-0fe340a9-8c2f-49b2-814d-12dd61837786 service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4460d465-cc97-4fd1-b2fa-ef25317fe543 req-0fe340a9-8c2f-49b2-814d-12dd61837786 service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-4460d465-cc97-4fd1-b2fa-ef25317fe543 req-0fe340a9-8c2f-49b2-814d-12dd61837786 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] No waiting events found dispatching network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:31 user nova-compute[72184]: WARNING nova.compute.manager [req-4460d465-cc97-4fd1-b2fa-ef25317fe543 req-0fe340a9-8c2f-49b2-814d-12dd61837786 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received unexpected event network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b for instance with vm_state building and task_state spawning.
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 01 16:53:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:31 user nova-compute[72184]: INFO nova.compute.manager [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Took 6.91 seconds to build instance.
Aug 01 16:53:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ee49fb06-37d8-47a1-8dbe-71b3e6a22df8 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "04d3b87c-2cec-499c-9972-b99310f6751f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.024s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance network_info: |[{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updated VIF entry in instance network info cache for port ccf96acb-280b-46df-ab5a-535ed5b54a83. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-ca101cc4-7cea-43c7-ada1-01298a576185. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:33 user nova-compute[72184]: DEBUG nova.network.neutron [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updated VIF entry in instance network info cache for port ca101cc4-7cea-43c7-ada1-01298a576185. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:53:33 user nova-compute[72184]: DEBUG nova.network.neutron [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79167ba5-7b21-4590-838e-e6c53fd875ab req-cbf66e91-b72b-4ee4-a801-86f475713e66 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:36 user nova-compute[72184]: INFO nova.virt.block_device [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Booting with volume 3f44d904-544c-4fa8-ab82-2bb6c66b6a38 at /dev/vdc
Aug 01 16:53:36 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47976754-e3d1-4435-a618-5490b8286bae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c256d7-1ae8-4890-ae74-c71d6a3b1344]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[031f87f5-1b02-4901-9975-6222337acf24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a6932a-f42f-4955-aec4-f1e9349849c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:37 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:53:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7bb890-6e6d-4030-853e-cb8c617e0be6]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating existing volume attachment record: e330a6ee-f57f-492e-9aff-8bb0987413f7 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:53:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:53:41 user nova-compute[72184]: INFO nova.compute.claims [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Claim successful on node user
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:53:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.policy [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5955b0107544c9cbce9e1c5c305cd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3358e9a5875f4d28b190013ad6eed14b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:53:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Creating image(s)
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "/opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "/opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "/opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:42 user nova-compute[72184]: INFO nova.compute.manager [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Rescuing
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk 1073741824" returned: 0 in 0.047s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Cannot resize image /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lazy-loading 'migration_context' on Instance uuid 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Ensure instance console log exists: /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Successfully created port: 7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updating instance_info_cache with network_info: [{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-e46253e2-b8f0-4b21-8bfd-da30cebc86f4 req-4118fe6e-cb25-42f3-90b8-91f136a91055 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e46253e2-b8f0-4b21-8bfd-da30cebc86f4 req-4118fe6e-cb25-42f3-90b8-91f136a91055 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e46253e2-b8f0-4b21-8bfd-da30cebc86f4 req-4118fe6e-cb25-42f3-90b8-91f136a91055 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e46253e2-b8f0-4b21-8bfd-da30cebc86f4 req-4118fe6e-cb25-42f3-90b8-91f136a91055 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-e46253e2-b8f0-4b21-8bfd-da30cebc86f4 req-4118fe6e-cb25-42f3-90b8-91f136a91055 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:43 user nova-compute[72184]: WARNING nova.compute.manager [req-e46253e2-b8f0-4b21-8bfd-da30cebc86f4 req-4118fe6e-cb25-42f3-90b8-91f136a91055 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance destroyed successfully.
Aug 01 16:53:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Attempting rescue
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 16:53:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Creating image(s)
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue" returned: 0 in 0.049s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'migration_context' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Start _get_guest_xml network_info=[{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:c4:f0:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'resources' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'numa_topology' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:43 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:43 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556921540',display_name='tempest-ServerRescueNegativeTestJSON-server-1556921540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556921540',id=3,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-16ucxoey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:13Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=a8b17402-c090-4e22-8ca7-06df5361d20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:c4:f0:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:c4:f0:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'pci_devices' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:53:43 user nova-compute[72184]:   <uuid>a8b17402-c090-4e22-8ca7-06df5361d20c</uuid>
Aug 01 16:53:43 user nova-compute[72184]:   <name>instance-00000003</name>
Aug 01 16:53:43 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:53:43 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:53:43 user nova-compute[72184]:   <metadata>
Aug 01 16:53:43 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:53:43 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:53:43 user nova-compute[72184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1556921540</nova:name>
Aug 01 16:53:43 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:53:43</nova:creationTime>
Aug 01 16:53:43 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:53:43 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:53:43 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:53:43 user nova-compute[72184]:       <nova:owner>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:user uuid="b0e33dc89b5744c2ad3c0d86f759c9c3">tempest-ServerRescueNegativeTestJSON-353659352-project-member</nova:user>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:project uuid="e0a62e50ced845abbadbe12339265fdc">tempest-ServerRescueNegativeTestJSON-353659352</nova:project>
Aug 01 16:53:43 user nova-compute[72184]:       </nova:owner>
Aug 01 16:53:43 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:53:43 user nova-compute[72184]:       <nova:ports>
Aug 01 16:53:43 user nova-compute[72184]:         <nova:port uuid="9529a526-8677-4545-bd95-3fecdfa3c8ed">
Aug 01 16:53:43 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:53:43 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:43 user nova-compute[72184]:       </nova:ports>
Aug 01 16:53:43 user nova-compute[72184]:     </nova:instance>
Aug 01 16:53:43 user nova-compute[72184]:   </metadata>
Aug 01 16:53:43 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:53:43 user nova-compute[72184]:     <system>
Aug 01 16:53:43 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:53:43 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:53:43 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:53:43 user nova-compute[72184]:       <entry name="serial">a8b17402-c090-4e22-8ca7-06df5361d20c</entry>
Aug 01 16:53:43 user nova-compute[72184]:       <entry name="uuid">a8b17402-c090-4e22-8ca7-06df5361d20c</entry>
Aug 01 16:53:43 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:53:43 user nova-compute[72184]:     </system>
Aug 01 16:53:43 user nova-compute[72184]:   </sysinfo>
Aug 01 16:53:43 user nova-compute[72184]:   <os>
Aug 01 16:53:43 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:53:43 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:53:43 user nova-compute[72184]:   </os>
Aug 01 16:53:43 user nova-compute[72184]:   <features>
Aug 01 16:53:43 user nova-compute[72184]:     <acpi/>
Aug 01 16:53:43 user nova-compute[72184]:     <apic/>
Aug 01 16:53:43 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:53:43 user nova-compute[72184]:   </features>
Aug 01 16:53:43 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:53:43 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:53:43 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:53:43 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:53:43 user nova-compute[72184]:   </clock>
Aug 01 16:53:43 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:53:43 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:53:43 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:53:43 user nova-compute[72184]:   </cpu>
Aug 01 16:53:43 user nova-compute[72184]:   <devices>
Aug 01 16:53:43 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:53:43 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:53:43 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue"/>
Aug 01 16:53:43 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:53:43 user nova-compute[72184]:     </disk>
Aug 01 16:53:43 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:53:43 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:53:43 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk"/>
Aug 01 16:53:43 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 16:53:43 user nova-compute[72184]:     </disk>
Aug 01 16:53:43 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:43 user nova-compute[72184]:       <mac address="fa:16:3e:c4:f0:f6"/>
Aug 01 16:53:43 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:43 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:43 user nova-compute[72184]:       <target dev="tap9529a526-86"/>
Aug 01 16:53:43 user nova-compute[72184]:     </interface>
Aug 01 16:53:43 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:53:43 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/console.log" append="off"/>
Aug 01 16:53:43 user nova-compute[72184]:     </serial>
Aug 01 16:53:43 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:53:43 user nova-compute[72184]:     <video>
Aug 01 16:53:43 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:43 user nova-compute[72184]:     </video>
Aug 01 16:53:43 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:53:43 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:53:43 user nova-compute[72184]:     </rng>
Aug 01 16:53:43 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:53:43 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:53:43 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:53:43 user nova-compute[72184]:     </memballoon>
Aug 01 16:53:43 user nova-compute[72184]:   </devices>
Aug 01 16:53:43 user nova-compute[72184]: </domain>
Aug 01 16:53:43 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:53:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance destroyed successfully.
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:c4:f0:f6, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Successfully updated port: 7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "refresh_cache-420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquired lock "refresh_cache-420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Updating instance_info_cache with network_info: [{"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Releasing lock "refresh_cache-420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Instance network_info: |[{"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Start _get_guest_xml network_info=[{"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:53:44 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:44 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-468467211',display_name='tempest-ServersNegativeTestJSON-server-468467211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-468467211',id=13,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3358e9a5875f4d28b190013ad6eed14b',ramdisk_id='',reservation_id='r-xa933t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2037366998',owner_user_name='tempest-ServersNegativeTestJSON-2037366998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:42Z,user_data=None,user_id='d5955b0107544c9cbce9e1c5c305cd3d',uuid=420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converting VIF {"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lazy-loading 'pci_devices' on Instance uuid 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:53:44 user nova-compute[72184]:   <uuid>420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f</uuid>
Aug 01 16:53:44 user nova-compute[72184]:   <name>instance-0000000d</name>
Aug 01 16:53:44 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:53:44 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:53:44 user nova-compute[72184]:   <metadata>
Aug 01 16:53:44 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:53:44 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:53:44 user nova-compute[72184]:       <nova:name>tempest-ServersNegativeTestJSON-server-468467211</nova:name>
Aug 01 16:53:44 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:53:44</nova:creationTime>
Aug 01 16:53:44 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:53:44 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:53:44 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:53:44 user nova-compute[72184]:       <nova:owner>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:user uuid="d5955b0107544c9cbce9e1c5c305cd3d">tempest-ServersNegativeTestJSON-2037366998-project-member</nova:user>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:project uuid="3358e9a5875f4d28b190013ad6eed14b">tempest-ServersNegativeTestJSON-2037366998</nova:project>
Aug 01 16:53:44 user nova-compute[72184]:       </nova:owner>
Aug 01 16:53:44 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:53:44 user nova-compute[72184]:       <nova:ports>
Aug 01 16:53:44 user nova-compute[72184]:         <nova:port uuid="7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78">
Aug 01 16:53:44 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 16:53:44 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:44 user nova-compute[72184]:       </nova:ports>
Aug 01 16:53:44 user nova-compute[72184]:     </nova:instance>
Aug 01 16:53:44 user nova-compute[72184]:   </metadata>
Aug 01 16:53:44 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:53:44 user nova-compute[72184]:     <system>
Aug 01 16:53:44 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:53:44 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:53:44 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:53:44 user nova-compute[72184]:       <entry name="serial">420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f</entry>
Aug 01 16:53:44 user nova-compute[72184]:       <entry name="uuid">420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f</entry>
Aug 01 16:53:44 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:53:44 user nova-compute[72184]:     </system>
Aug 01 16:53:44 user nova-compute[72184]:   </sysinfo>
Aug 01 16:53:44 user nova-compute[72184]:   <os>
Aug 01 16:53:44 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:53:44 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:53:44 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:53:44 user nova-compute[72184]:   </os>
Aug 01 16:53:44 user nova-compute[72184]:   <features>
Aug 01 16:53:44 user nova-compute[72184]:     <acpi/>
Aug 01 16:53:44 user nova-compute[72184]:     <apic/>
Aug 01 16:53:44 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:53:44 user nova-compute[72184]:   </features>
Aug 01 16:53:44 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:53:44 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:53:44 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:53:44 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:53:44 user nova-compute[72184]:   </clock>
Aug 01 16:53:44 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:53:44 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:53:44 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:53:44 user nova-compute[72184]:   </cpu>
Aug 01 16:53:44 user nova-compute[72184]:   <devices>
Aug 01 16:53:44 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:53:44 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:53:44 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk"/>
Aug 01 16:53:44 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:53:44 user nova-compute[72184]:     </disk>
Aug 01 16:53:44 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:44 user nova-compute[72184]:       <mac address="fa:16:3e:c2:5a:7d"/>
Aug 01 16:53:44 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:44 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:44 user nova-compute[72184]:       <target dev="tap7e5d5ce5-f5"/>
Aug 01 16:53:44 user nova-compute[72184]:     </interface>
Aug 01 16:53:44 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:53:44 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/console.log" append="off"/>
Aug 01 16:53:44 user nova-compute[72184]:     </serial>
Aug 01 16:53:44 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:53:44 user nova-compute[72184]:     <video>
Aug 01 16:53:44 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:44 user nova-compute[72184]:     </video>
Aug 01 16:53:44 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:53:44 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:53:44 user nova-compute[72184]:     </rng>
Aug 01 16:53:44 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:53:44 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:53:44 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:53:44 user nova-compute[72184]:     </memballoon>
Aug 01 16:53:44 user nova-compute[72184]:   </devices>
Aug 01 16:53:44 user nova-compute[72184]: </domain>
Aug 01 16:53:44 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-468467211',display_name='tempest-ServersNegativeTestJSON-server-468467211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-468467211',id=13,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3358e9a5875f4d28b190013ad6eed14b',ramdisk_id='',reservation_id='r-xa933t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2037366998',owner_user_name='tempest-ServersNegativeTestJSON-2037366998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:42Z,user_data=None,user_id='d5955b0107544c9cbce9e1c5c305cd3d',uuid=420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converting VIF {"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG os_vif [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e5d5ce5-f5, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e5d5ce5-f5, col_values=(('external_ids', {'iface-id': '7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:5a:7d', 'vm-uuid': '420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:44 user nova-compute[72184]: INFO os_vif [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5')
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] No VIF found with MAC fa:16:3e:c2:5a:7d, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-changed-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Refreshing instance network info cache due to event network-changed-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquiring lock "refresh_cache-420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquired lock "refresh_cache-420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG nova.network.neutron [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Refreshing network info cache for port 7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Updated VIF entry in instance network info cache for port 7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Updating instance_info_cache with network_info: [{"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Releasing lock "refresh_cache-420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:46 user nova-compute[72184]: WARNING nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:46 user nova-compute[72184]: WARNING nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:46 user nova-compute[72184]: WARNING nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:46 user nova-compute[72184]: WARNING nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:46 user nova-compute[72184]: WARNING nova.compute.manager [req-eaab4f07-9d01-47b7-8519-1979c5d1a16b req-91955146-89cf-4cf6-a56b-e55ffd425209 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:46 user nova-compute[72184]: INFO nova.compute.manager [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] instance snapshotting
Aug 01 16:53:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Beginning live snapshot process
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbac5qf1v/34d1d73c5e4343179086294dae0b7eb4.delta 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbac5qf1v/34d1d73c5e4343179086294dae0b7eb4.delta 1073741824" returned: 0 in 0.058s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72184) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 16:53:47 user nova-compute[72184]: INFO nova.virt.libvirt.host [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] UEFI support detected
Aug 01 16:53:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-9bb5331e-c7b1-41f8-990e-3dda2cfd2223 req-56e44b0f-5485-403a-a167-736c7f501b9b service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9bb5331e-c7b1-41f8-990e-3dda2cfd2223 req-56e44b0f-5485-403a-a167-736c7f501b9b service nova] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9bb5331e-c7b1-41f8-990e-3dda2cfd2223 req-56e44b0f-5485-403a-a167-736c7f501b9b service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9bb5331e-c7b1-41f8-990e-3dda2cfd2223 req-56e44b0f-5485-403a-a167-736c7f501b9b service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-9bb5331e-c7b1-41f8-990e-3dda2cfd2223 req-56e44b0f-5485-403a-a167-736c7f501b9b service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] No waiting events found dispatching network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:47 user nova-compute[72184]: WARNING nova.compute.manager [req-9bb5331e-c7b1-41f8-990e-3dda2cfd2223 req-56e44b0f-5485-403a-a167-736c7f501b9b service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received unexpected event network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 for instance with vm_state building and task_state spawning.
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:47 user nova-compute[72184]: WARNING nova.compute.manager [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:47 user nova-compute[72184]: WARNING nova.compute.manager [req-42af72e2-4ce6-4660-b600-e56623a41e79 req-d350f1a5-c452-497e-b922-f4a3934a7611 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state active and task_state rescuing.
Aug 01 16:53:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:53:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbac5qf1v/34d1d73c5e4343179086294dae0b7eb4.delta /opt/stack/data/nova/instances/snapshots/tmpbac5qf1v/34d1d73c5e4343179086294dae0b7eb4 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbac5qf1v/34d1d73c5e4343179086294dae0b7eb4.delta /opt/stack/data/nova/instances/snapshots/tmpbac5qf1v/34d1d73c5e4343179086294dae0b7eb4" returned: 0 in 0.276s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Snapshot extracted, beginning image upload
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for a8b17402-c090-4e22-8ca7-06df5361d20c due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908829.1925588, a8b17402-c090-4e22-8ca7-06df5361d20c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:53:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] VM Resumed (Lifecycle Event)
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-15a244aa-25d1-45c3-9ed2-a50c8d3b42bd tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:53:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908829.1982422, a8b17402-c090-4e22-8ca7-06df5361d20c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:53:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] VM Started (Lifecycle Event)
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [req-b60e3ec4-5282-4e34-857a-136d9064d34a req-1ed912a6-5eed-4e68-858d-c6640ce5aa50 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b60e3ec4-5282-4e34-857a-136d9064d34a req-1ed912a6-5eed-4e68-858d-c6640ce5aa50 service nova] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b60e3ec4-5282-4e34-857a-136d9064d34a req-1ed912a6-5eed-4e68-858d-c6640ce5aa50 service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b60e3ec4-5282-4e34-857a-136d9064d34a req-1ed912a6-5eed-4e68-858d-c6640ce5aa50 service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG nova.compute.manager [req-b60e3ec4-5282-4e34-857a-136d9064d34a req-1ed912a6-5eed-4e68-858d-c6640ce5aa50 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] No waiting events found dispatching network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:53:49 user nova-compute[72184]: WARNING nova.compute.manager [req-b60e3ec4-5282-4e34-857a-136d9064d34a req-1ed912a6-5eed-4e68-858d-c6640ce5aa50 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received unexpected event network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 for instance with vm_state building and task_state spawning.
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908830.4400792, 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] VM Resumed (Lifecycle Event)
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Instance spawned successfully.
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908830.4444506, 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] VM Started (Lifecycle Event)
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Took 8.89 seconds to spawn the instance on the hypervisor.
Aug 01 16:53:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:50 user nova-compute[72184]: INFO nova.compute.manager [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Took 9.77 seconds to build instance.
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7214e017-f90e-412a-8057-59ec418fc71d tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.889s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Snapshot image upload complete
Aug 01 16:53:52 user nova-compute[72184]: INFO nova.compute.manager [None req-2653c287-bd85-4563-8729-eca732a23aec tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Took 5.56 seconds to snapshot the instance on the hypervisor.
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:53:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Creating image(s)
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Start _get_guest_xml network_info=[{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '077346ea-6641-4bb2-83b9-15ca22362cf9', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpVTMCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '0d2a6236-79ce-423d-8e01-027acd743f15', 'serial': '0d2a6236-79ce-423d-8e01-027acd743f15'}, 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '06bcba66-6a81-4c82-8f45-396eb812cb49', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiLAwrSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '1fc1ced7-e7d1-482c-a958-bd43b92636c6', 'serial': '1fc1ced7-e7d1-482c-a958-bd43b92636c6'}, 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e330a6ee-f57f-492e-9aff-8bb0987413f7', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcHyQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '3f44d904-544c-4fa8-ab82-2bb6c66b6a38', 'serial': '3f44d904-544c-4fa8-ab82-2bb6c66b6a38'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG os_brick.initiator.connector [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Factory for ISCSI on None {{(pid=72184) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpVTMCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:53:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:53:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:53:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:53:52 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d4465b-66c2-4f26-8551-0ab6029afb54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:53:53 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8040468-701a-4b9b-a310-229301df4fe2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15] added
Aug 01 16:53:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbdcfb3-6922-438b-a321-44a7a6f17c42]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eff29c-e5d3-4e30-bcfe-bb3d78c783ea]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpVTMCUK {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpVTMCUK" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1c4ad-728a-40f9-9eff-90f07aa6d89e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpVTMCUK'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca1d8a6-0370-449b-995c-2cb80b6b36bd]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f914d1b-a6e9-4ec0-b430-168280e4978d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:53:53 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:53:53 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:53:53 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:53:53 user nova-compute[72184]: 
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8634a0b1-2d46-41e0-8734-f6977cc68594]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260]
Aug 01 16:53:53 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260] successful.
Aug 01 16:53:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-changed-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Refreshing instance network info cache due to event network-changed-05c07b8d-e31d-4dce-8b1b-ac6047c29540. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] Acquiring lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] Acquired lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.network.neutron [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Refreshing network info cache for port 05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-changed-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Refreshing instance network info cache due to event network-changed-0f436652-34b6-45b4-bf2b-0eaea58addd0. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] Acquiring lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] Acquired lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.network.neutron [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Refreshing network info cache for port 0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:53:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=6700MB free_disk=25.558643341064453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33347091-0c43-4a99-bdcf-ac881727a7d3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0ef30-912f-40bd-be55-e5a507db35bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.016s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:53:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd7ceb9-f26a-4fd5-b350-6d6049f89737]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpVTMCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7b407b54-6887-4b20-a3ae-50a2ce5777be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 70e188c4-72bc-4842-bb3f-a9d611c38164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7896ab2a-6313-459a-b5b9-916929f96970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 04d3b87c-2cec-499c-9972-b99310f6751f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.871s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updated VIF entry in instance network info cache for port 05c07b8d-e31d-4dce-8b1b-ac6047c29540. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updating instance_info_cache with network_info: [{"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ca69b59d-6484-4812-ba24-a4d1c0f4032d req-9484359e-cdbe-43c2-b9ad-5ed6af48cb7b service nova] Releasing lock "refresh_cache-8d331546-ccb4-4794-b3b8-ef5049640db6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.067s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== connect_volume: return (2069ms) {'type': 'block', 'scsi_wwn': '23437646532373263', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437646532373263', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiLAwrSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:55 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:53:55 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:53:55 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f01613-52ae-481e-b8de-a14fb387626f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:53:55 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b366af0-c4ab-4b4b-ba4b-40e219c60ba2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6] added
Aug 01 16:53:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f659d59a-1eb9-4f7f-9cf7-1d523cc34945]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updated VIF entry in instance network info cache for port 0f436652-34b6-45b4-bf2b-0eaea58addd0. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updating instance_info_cache with network_info: [{"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cceda3f-5070-4586-9eac-c3656f08a095 req-58a76619-585e-406d-9f42-bce309c296af service nova] Releasing lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa28d7-b5bb-41da-a1de-a47add434abf]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiLAwrSH {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiLAwrSH" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379dbc9-5123-4449-b2d7-b22dc963dd66]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiLAwrSH'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0b37b-b861-4e82-a684-b5feb99dd9d6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b006a-8bd9-4ab2-9118-0dfeb3ef1700]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e05b302-76a8-4273-938c-c4e2565f085a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260]
Aug 01 16:53:55 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260] successful.
Aug 01 16:53:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3064b7c-ef73-4657-a17c-1eb16921e1ce]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace6ea2-47f5-4161-b34e-bf8ab26c3815]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:55 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:53:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:55 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:53:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4513a88-302b-435f-9c4d-b935c97ce232]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiLAwrSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:53:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26631653231306637', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631653231306637', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcHyQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:56 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:53:56 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:53:56 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a107a88-a312-4cbe-b7f9-3a216a2f51f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:53:56 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce676a6-ea06-4436-acdf-c8317e6a5e51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38] added
Aug 01 16:53:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0b6b1-5137-4152-90f2-b085c5d70168]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2683d5f7-4d39-4fa1-94f0-070c684a9642]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkCcHyQP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkCcHyQP" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eae0b5-63d0-4bb5-833c-8168764e3b7f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkCcHyQP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3725bad-2f56-44e0-9868-47054ccabb1b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[508a619c-7b03-4869-a33a-2ee2f30ff227]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --login" returned: 0 in 0.127s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c0516-b13e-4e3f-bb2b-dfdf711324a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260]
Aug 01 16:53:56 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260] successful.
Aug 01 16:53:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.057s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84b12a8-ec5c-4d87-abce-c95b1a99f873]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.089s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb6200e-b286-42a6-8a1e-101ee60d6405]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:53:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.484s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:53:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.099s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcca9fb1-b4f8-48c2-8b2a-d80a66d345a3]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcHyQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:53:57 user nova-compute[72184]: INFO nova.compute.manager [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Attaching volume e04c93e9-f21c-4136-965d-2e566039948d to /dev/vdb
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.utils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8314152-7dfa-4fc0-a5b8-137c561f6aa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b943e4-419e-4a3a-9de9-aadf9c147f55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a393ef-0b64-46ec-a829-48a0c8ed01b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a534410f-216a-4927-9962-9aa4e5f8eba1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:53:57 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:53:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89797db1-7c7c-4cf3-9289-fd533478eca8]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG os_brick.utils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:57 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updating existing volume attachment record: c31e0076-337b-4ad9-8b1a-b1a27efd583e {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.621s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== connect_volume: return (1624ms) {'type': 'block', 'scsi_wwn': '23134366233376430', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134366233376430', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lazy-loading 'pci_devices' on Instance uuid 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:53:58 user nova-compute[72184]:   <uuid>01fe9d2f-11ec-4b10-979b-d1b0896c5c2c</uuid>
Aug 01 16:53:58 user nova-compute[72184]:   <name>instance-0000000b</name>
Aug 01 16:53:58 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:53:58 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:53:58 user nova-compute[72184]:   <metadata>
Aug 01 16:53:58 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:53:58 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:53:58 user nova-compute[72184]:       <nova:name>tempest-device-tagging-server-1200243041</nova:name>
Aug 01 16:53:58 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:53:52</nova:creationTime>
Aug 01 16:53:58 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:53:58 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:53:58 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:53:58 user nova-compute[72184]:       <nova:owner>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:user uuid="3f439bc4e6d14fc9af440d9c86f48d55">tempest-TaggedBootDevicesTest_v242-1184634350-project-member</nova:user>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:project uuid="7bb864281a044721bd9fbf84d80c01b9">tempest-TaggedBootDevicesTest_v242-1184634350</nova:project>
Aug 01 16:53:58 user nova-compute[72184]:       </nova:owner>
Aug 01 16:53:58 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:53:58 user nova-compute[72184]:       <nova:ports>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="13d4efe4-5871-4e5f-b474-5df9ffb1339a">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="3c99fc28-3863-4b6d-a7a2-d762e2e86538">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="6c582588-6620-4f3e-b7d9-1a87cdff3120">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="aafdad05-0ebd-466e-a2c0-9e41a431847e">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="358d82a9-c685-43e5-9484-3762fd03d794">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="ccf96acb-280b-46df-ab5a-535ed5b54a83">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:         <nova:port uuid="ca101cc4-7cea-43c7-ada1-01298a576185">
Aug 01 16:53:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 16:53:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:53:58 user nova-compute[72184]:       </nova:ports>
Aug 01 16:53:58 user nova-compute[72184]:     </nova:instance>
Aug 01 16:53:58 user nova-compute[72184]:   </metadata>
Aug 01 16:53:58 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:53:58 user nova-compute[72184]:     <system>
Aug 01 16:53:58 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:53:58 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:53:58 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:53:58 user nova-compute[72184]:       <entry name="serial">01fe9d2f-11ec-4b10-979b-d1b0896c5c2c</entry>
Aug 01 16:53:58 user nova-compute[72184]:       <entry name="uuid">01fe9d2f-11ec-4b10-979b-d1b0896c5c2c</entry>
Aug 01 16:53:58 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:53:58 user nova-compute[72184]:     </system>
Aug 01 16:53:58 user nova-compute[72184]:   </sysinfo>
Aug 01 16:53:58 user nova-compute[72184]:   <os>
Aug 01 16:53:58 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:53:58 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:53:58 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:53:58 user nova-compute[72184]:   </os>
Aug 01 16:53:58 user nova-compute[72184]:   <features>
Aug 01 16:53:58 user nova-compute[72184]:     <acpi/>
Aug 01 16:53:58 user nova-compute[72184]:     <apic/>
Aug 01 16:53:58 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:53:58 user nova-compute[72184]:   </features>
Aug 01 16:53:58 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:53:58 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:53:58 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:53:58 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:53:58 user nova-compute[72184]:   </clock>
Aug 01 16:53:58 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:53:58 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:53:58 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:53:58 user nova-compute[72184]:   </cpu>
Aug 01 16:53:58 user nova-compute[72184]:   <devices>
Aug 01 16:53:58 user nova-compute[72184]:     <disk type="file" device="cdrom">
Aug 01 16:53:58 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 16:53:58 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c/disk.config"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="hda" bus="ide"/>
Aug 01 16:53:58 user nova-compute[72184]:     </disk>
Aug 01 16:53:58 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:53:58 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:53:58 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <serial>0d2a6236-79ce-423d-8e01-027acd743f15</serial>
Aug 01 16:53:58 user nova-compute[72184]:     </disk>
Aug 01 16:53:58 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:53:58 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:53:58 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <serial>1fc1ced7-e7d1-482c-a958-bd43b92636c6</serial>
Aug 01 16:53:58 user nova-compute[72184]:     </disk>
Aug 01 16:53:58 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:53:58 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:53:58 user nova-compute[72184]:       <source dev="/dev/sdd"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="vdc" bus="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <serial>3f44d904-544c-4fa8-ab82-2bb6c66b6a38</serial>
Aug 01 16:53:58 user nova-compute[72184]:     </disk>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:72:d5:dc"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tap13d4efe4-58"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:a4:63:ac"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tap3c99fc28-38"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:1d:80:b9"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tap6c582588-66"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:7a:54:cd"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tapaafdad05-0e"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:f4:9b:64"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tap358d82a9-c6"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:54:3f:a3"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tapccf96acb-28"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:53:58 user nova-compute[72184]:       <mac address="fa:16:3e:56:18:a2"/>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:53:58 user nova-compute[72184]:       <target dev="tapca101cc4-7c"/>
Aug 01 16:53:58 user nova-compute[72184]:     </interface>
Aug 01 16:53:58 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:53:58 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c/console.log" append="off"/>
Aug 01 16:53:58 user nova-compute[72184]:     </serial>
Aug 01 16:53:58 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:53:58 user nova-compute[72184]:     <video>
Aug 01 16:53:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:53:58 user nova-compute[72184]:     </video>
Aug 01 16:53:58 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:53:58 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:53:58 user nova-compute[72184]:     </rng>
Aug 01 16:53:58 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:53:58 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:53:58 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:53:58 user nova-compute[72184]:     </memballoon>
Aug 01 16:53:58 user nova-compute[72184]:   </devices>
Aug 01 16:53:58 user nova-compute[72184]: </domain>
Aug 01 16:53:58 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13d4efe4-58, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13d4efe4-58, col_values=(('external_ids', {'iface-id': '13d4efe4-5871-4e5f-b474-5df9ffb1339a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:d5:dc', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c99fc28-38, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c99fc28-38, col_values=(('external_ids', {'iface-id': '3c99fc28-3863-4b6d-a7a2-d762e2e86538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:63:ac', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c582588-66, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c582588-66, col_values=(('external_ids', {'iface-id': '6c582588-6620-4f3e-b7d9-1a87cdff3120', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:80:b9', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaafdad05-0e, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaafdad05-0e, col_values=(('external_ids', {'iface-id': 'aafdad05-0ebd-466e-a2c0-9e41a431847e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:54:cd', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap358d82a9-c6, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap358d82a9-c6, col_values=(('external_ids', {'iface-id': '358d82a9-c685-43e5-9484-3762fd03d794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:9b:64', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf96acb-28, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccf96acb-28, col_values=(('external_ids', {'iface-id': 'ccf96acb-280b-46df-ab5a-535ed5b54a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:3f:a3', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca101cc4-7c, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca101cc4-7c, col_values=(('external_ids', {'iface-id': 'ca101cc4-7cea-43c7-ada1-01298a576185', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:18:a2', 'vm-uuid': '01fe9d2f-11ec-4b10-979b-d1b0896c5c2c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:53:58 user nova-compute[72184]: INFO os_vif [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c')
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] No BDM found with device name hda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] No VIF found with MAC fa:16:3e:72:d5:dc, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] No VIF found with MAC fa:16:3e:f4:9b:64, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:53:58 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Using config drive
Aug 01 16:53:58 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Creating config drive at /opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c/disk.config
Aug 01 16:53:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_do2qwiu {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:53:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_do2qwiu" returned: 0 in 0.106s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-ada6a2cf-3297-4669-ad2d-7dc2c346f5aa req-624d4f29-2480-4bad-86b0-f054c493ea56 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ada6a2cf-3297-4669-ad2d-7dc2c346f5aa req-624d4f29-2480-4bad-86b0-f054c493ea56 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ada6a2cf-3297-4669-ad2d-7dc2c346f5aa req-624d4f29-2480-4bad-86b0-f054c493ea56 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ada6a2cf-3297-4669-ad2d-7dc2c346f5aa req-624d4f29-2480-4bad-86b0-f054c493ea56 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-ada6a2cf-3297-4669-ad2d-7dc2c346f5aa req-624d4f29-2480-4bad-86b0-f054c493ea56 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:01 user nova-compute[72184]: WARNING nova.compute.manager [req-ada6a2cf-3297-4669-ad2d-7dc2c346f5aa req-624d4f29-2480-4bad-86b0-f054c493ea56 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a for instance with vm_state building and task_state spawning.
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-8ec8960e-60bf-4971-b534-c3c265913198 req-e27b866a-a25c-4ae5-a9d3-bccc34c21e6d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ec8960e-60bf-4971-b534-c3c265913198 req-e27b866a-a25c-4ae5-a9d3-bccc34c21e6d service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ec8960e-60bf-4971-b534-c3c265913198 req-e27b866a-a25c-4ae5-a9d3-bccc34c21e6d service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ec8960e-60bf-4971-b534-c3c265913198 req-e27b866a-a25c-4ae5-a9d3-bccc34c21e6d service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-8ec8960e-60bf-4971-b534-c3c265913198 req-e27b866a-a25c-4ae5-a9d3-bccc34c21e6d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:02 user nova-compute[72184]: WARNING nova.compute.manager [req-8ec8960e-60bf-4971-b534-c3c265913198 req-e27b866a-a25c-4ae5-a9d3-bccc34c21e6d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 for instance with vm_state building and task_state spawning.
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-1836a481-8a36-404e-ab6c-c3b272dd1694 req-c4325284-55c2-43ee-99bc-9d508896f5bf service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1836a481-8a36-404e-ab6c-c3b272dd1694 req-c4325284-55c2-43ee-99bc-9d508896f5bf service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1836a481-8a36-404e-ab6c-c3b272dd1694 req-c4325284-55c2-43ee-99bc-9d508896f5bf service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1836a481-8a36-404e-ab6c-c3b272dd1694 req-c4325284-55c2-43ee-99bc-9d508896f5bf service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-1836a481-8a36-404e-ab6c-c3b272dd1694 req-c4325284-55c2-43ee-99bc-9d508896f5bf service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:03 user nova-compute[72184]: WARNING nova.compute.manager [req-1836a481-8a36-404e-ab6c-c3b272dd1694 req-c4325284-55c2-43ee-99bc-9d508896f5bf service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 for instance with vm_state building and task_state spawning.
Aug 01 16:54:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:03 user nova-compute[72184]: WARNING nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a for instance with vm_state building and task_state spawning.
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing instance network info cache due to event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:04 user nova-compute[72184]: WARNING nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 for instance with vm_state building and task_state spawning.
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:04 user nova-compute[72184]: WARNING nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e for instance with vm_state building and task_state spawning.
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:04 user nova-compute[72184]: WARNING nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e for instance with vm_state building and task_state spawning.
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:04 user nova-compute[72184]: WARNING nova.compute.manager [req-9e2e0a1c-aa12-4e63-85a4-6998fb1bc4cb req-fb9b3a52-f42a-4c85-8438-24758c06a0db service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 for instance with vm_state building and task_state spawning.
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updated VIF entry in instance network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:04 user nova-compute[72184]: WARNING nova.compute.manager [req-0ac5f76e-1660-4abf-a3eb-2121b3d75b66 req-c72d0d15-18ba-4fb2-8c61-a164bf8b6b76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 for instance with vm_state building and task_state spawning.
Aug 01 16:54:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:05 user nova-compute[72184]: INFO nova.compute.manager [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] instance snapshotting
Aug 01 16:54:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Beginning live snapshot process
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json -f qcow2" returned: 0 in 0.279s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-d7584cdf-5d19-4c7e-bfe0-d5ac43a6744e req-295ac85f-6f51-4b2b-a55b-dfac5a9d25c6 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d7584cdf-5d19-4c7e-bfe0-d5ac43a6744e req-295ac85f-6f51-4b2b-a55b-dfac5a9d25c6 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d7584cdf-5d19-4c7e-bfe0-d5ac43a6744e req-295ac85f-6f51-4b2b-a55b-dfac5a9d25c6 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d7584cdf-5d19-4c7e-bfe0-d5ac43a6744e req-295ac85f-6f51-4b2b-a55b-dfac5a9d25c6 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-d7584cdf-5d19-4c7e-bfe0-d5ac43a6744e req-295ac85f-6f51-4b2b-a55b-dfac5a9d25c6 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:05 user nova-compute[72184]: WARNING nova.compute.manager [req-d7584cdf-5d19-4c7e-bfe0-d5ac43a6744e req-295ac85f-6f51-4b2b-a55b-dfac5a9d25c6 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 for instance with vm_state building and task_state spawning.
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:06 user nova-compute[72184]: WARNING nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 for instance with vm_state building and task_state spawning.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:06 user nova-compute[72184]: WARNING nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 for instance with vm_state building and task_state spawning.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:06 user nova-compute[72184]: WARNING nova.compute.manager [req-d1676cf0-1125-4fc7-ace2-8af14631dc7b req-baa979c3-d5cb-4d6f-b8c5-fd818635e012 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 for instance with vm_state building and task_state spawning.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1hk2_vvu/1bd6f0e1467043bab84b6ec9934eb2d7.delta 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1hk2_vvu/1bd6f0e1467043bab84b6ec9934eb2d7.delta 1073741824" returned: 0 in 0.063s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908846.2853203, 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] VM Resumed (Lifecycle Event)
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance spawned successfully.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908846.2868943, 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] VM Started (Lifecycle Event)
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-18447c2d-cb44-4fcd-8359-84c899a06b13 req-3089146a-3614-475d-ac33-5a7b0097368c service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18447c2d-cb44-4fcd-8359-84c899a06b13 req-3089146a-3614-475d-ac33-5a7b0097368c service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18447c2d-cb44-4fcd-8359-84c899a06b13 req-3089146a-3614-475d-ac33-5a7b0097368c service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18447c2d-cb44-4fcd-8359-84c899a06b13 req-3089146a-3614-475d-ac33-5a7b0097368c service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-18447c2d-cb44-4fcd-8359-84c899a06b13 req-3089146a-3614-475d-ac33-5a7b0097368c service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:06 user nova-compute[72184]: WARNING nova.compute.manager [req-18447c2d-cb44-4fcd-8359-84c899a06b13 req-3089146a-3614-475d-ac33-5a7b0097368c service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 for instance with vm_state building and task_state spawning.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Took 13.73 seconds to spawn the instance on the hypervisor.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:54:06 user nova-compute[72184]: INFO nova.compute.manager [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Took 48.62 seconds to build instance.
Aug 01 16:54:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a37ff9-fa57-4f88-b804-816e8ea1b90f tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.746s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:07 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 16:54:07 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:54:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1hk2_vvu/1bd6f0e1467043bab84b6ec9934eb2d7.delta /opt/stack/data/nova/instances/snapshots/tmp1hk2_vvu/1bd6f0e1467043bab84b6ec9934eb2d7 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1hk2_vvu/1bd6f0e1467043bab84b6ec9934eb2d7.delta /opt/stack/data/nova/instances/snapshots/tmp1hk2_vvu/1bd6f0e1467043bab84b6ec9934eb2d7" returned: 0 in 0.333s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:07 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Snapshot extracted, beginning image upload
Aug 01 16:54:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:54:08 user nova-compute[72184]: INFO nova.compute.claims [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Claim successful on node user
Aug 01 16:54:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:54:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:54:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:54:09 user nova-compute[72184]: INFO nova.virt.block_device [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Booting with volume e024d764-d153-4abd-9082-22daa0510480 at /dev/vda
Aug 01 16:54:09 user nova-compute[72184]: DEBUG nova.policy [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe5c17c4d0a84d27ad28486da91673bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac23356679f461282fce02ad71f2442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG os_brick.utils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77585b2c-a11b-4fd7-ba86-fe85e81730a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1a49b-8362-4c02-a90e-67650ab9b2c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.239s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e00eb5-8e5f-44c1-b2cf-bab534b069b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a1760a-54f8-4b54-a404-e2929a7712a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:09 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:54:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f5733b-f02f-4359-bc9c-ae587f8a7cd0]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG os_brick.utils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== get_connector_properties: return (352ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:09 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating existing volume attachment record: 9ecda456-1d8f-4450-9488-bfa5d45f4f56 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Successfully created port: 415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:54:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Snapshot image upload complete
Aug 01 16:54:10 user nova-compute[72184]: INFO nova.compute.manager [None req-6a331014-61f0-4117-885a-b4492805f757 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Took 5.41 seconds to snapshot the instance on the hypervisor.
Aug 01 16:54:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Successfully updated port: 415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquired lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-changed-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Refreshing instance network info cache due to event network-changed-415b8e1b-0e0d-4209-b151-4474047270e8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] Acquiring lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating instance_info_cache with network_info: [{"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Releasing lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance network_info: |[{"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] Acquired lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG nova.network.neutron [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Refreshing network info cache for port 415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzkNRXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:11 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed06dc7-5d41-4ed9-b6b5-e6716231a91d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:54:11 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd1bfb-a558-4902-98c3-0edb649d02eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d] added
Aug 01 16:54:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37ebfe-2602-44c7-bda2-302123ed8b32]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96408a6-d69d-4f39-b2ed-846422f6bcf9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzkNRXsL {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzkNRXsL" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff82d4-a2db-4d56-98f0-13c4018cd494]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzkNRXsL'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f097757a-d72e-4ef7-b464-f4230e2bcdf7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a57d39-2c88-479d-b5f7-fdac414ebeb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44230191-bf34-44a7-b0af-6c2fd19d1fdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260]
Aug 01 16:54:11 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b5082-ce5f-4393-8638-bcdc3b0994f2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f611b8-55fb-421d-9c1a-f4cfd024a18a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:11 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728ab92-eefb-45d1-875f-13cadc5cdf43]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:54:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzkNRXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updated VIF entry in instance network info cache for port 415b8e1b-0e0d-4209-b151-4474047270e8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating instance_info_cache with network_info: [{"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1e58d042-ea4d-4a34-8997-c7b2e8d57534 req-d224eda7-bea8-4d27-9449-484f12019387 service nova] Releasing lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26438666631633130', 'path': '/dev/sde'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438666631633130', 'path': '/dev/sde'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG nova.objects.instance [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:54:12 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:12 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 16:54:12 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:54:12 user nova-compute[72184]:   <serial>e04c93e9-f21c-4136-965d-2e566039948d</serial>
Aug 01 16:54:12 user nova-compute[72184]: </disk>
Aug 01 16:54:12 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:54:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:64:52:f0, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:54:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dde01257-5462-4c40-b953-45a99744e519 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.778s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:54:17 user nova-compute[72184]: INFO nova.compute.claims [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Claim successful on node user
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-changed-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Refreshing instance network info cache due to event network-changed-36c18de7-3c3e-4a20-b6da-1916d8e12323. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] Acquiring lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] Acquired lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.network.neutron [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Refreshing network info cache for port 36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.network.neutron [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updated VIF entry in instance network info cache for port 36c18de7-3c3e-4a20-b6da-1916d8e12323. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.network.neutron [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updating instance_info_cache with network_info: [{"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-899bb336-901c-4211-a9c2-aefa24f358e1 req-ed1dc935-c388-4581-913f-9c869d086e48 service nova] Releasing lock "refresh_cache-70e188c4-72bc-4842-bb3f-a9d611c38164" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.network.neutron [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:54:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:54:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.policy [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '154bf9bc1d904d55a86bd739a2f65677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7490e7fdbe46cd8618b6431046108b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:54:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Creating image(s)
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "/opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk 1073741824" returned: 0 in 0.055s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.network.neutron [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Successfully created port: efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Cannot resize image /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.objects.instance [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'migration_context' on Instance uuid 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Ensure instance console log exists: /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-changed-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Refreshing instance network info cache due to event network-changed-161ebe17-3cae-4663-885d-2fa0cee0f8d8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] Acquiring lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] Acquired lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Refreshing network info cache for port 161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Successfully updated port: efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquired lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-changed-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Refreshing instance network info cache due to event network-changed-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] Acquiring lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updated VIF entry in instance network info cache for port 161ebe17-3cae-4663-885d-2fa0cee0f8d8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updating instance_info_cache with network_info: [{"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f43feb04-814f-48a8-a6f9-db44e2946550 req-610ee40a-0cc0-4661-9b0a-c83409371335 service nova] Releasing lock "refresh_cache-7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updating instance_info_cache with network_info: [{"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Releasing lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Instance network_info: |[{"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] Acquired lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Refreshing network info cache for port efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Start _get_guest_xml network_info=[{"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:54:19 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:54:19 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2073617209',display_name='tempest-AttachVolumeNegativeTest-server-2073617209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2073617209',id=15,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIrM/dMD2srrNBXHvHI/RLapeuSotCc8AFLiOoMODsR2ZvNR0hzlC3YZXdHchOw8sLU8d87QVyQhKrogSC98EDmweBqBurlkf+MjAo41bvWq1JO3TM+3EjZ1zjT5hcPqw==',key_name='tempest-keypair-2016280627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-8bdpzxfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'pci_devices' on Instance uuid 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:54:19 user nova-compute[72184]:   <uuid>0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a</uuid>
Aug 01 16:54:19 user nova-compute[72184]:   <name>instance-0000000f</name>
Aug 01 16:54:19 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:54:19 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:54:19 user nova-compute[72184]:   <metadata>
Aug 01 16:54:19 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:54:19 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:54:19 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2073617209</nova:name>
Aug 01 16:54:19 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:54:19</nova:creationTime>
Aug 01 16:54:19 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:54:19 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:54:19 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:54:19 user nova-compute[72184]:       <nova:owner>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:user uuid="154bf9bc1d904d55a86bd739a2f65677">tempest-AttachVolumeNegativeTest-1778743204-project-member</nova:user>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:project uuid="9b7490e7fdbe46cd8618b6431046108b">tempest-AttachVolumeNegativeTest-1778743204</nova:project>
Aug 01 16:54:19 user nova-compute[72184]:       </nova:owner>
Aug 01 16:54:19 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:54:19 user nova-compute[72184]:       <nova:ports>
Aug 01 16:54:19 user nova-compute[72184]:         <nova:port uuid="efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea">
Aug 01 16:54:19 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 16:54:19 user nova-compute[72184]:         </nova:port>
Aug 01 16:54:19 user nova-compute[72184]:       </nova:ports>
Aug 01 16:54:19 user nova-compute[72184]:     </nova:instance>
Aug 01 16:54:19 user nova-compute[72184]:   </metadata>
Aug 01 16:54:19 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:54:19 user nova-compute[72184]:     <system>
Aug 01 16:54:19 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:54:19 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:54:19 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:54:19 user nova-compute[72184]:       <entry name="serial">0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a</entry>
Aug 01 16:54:19 user nova-compute[72184]:       <entry name="uuid">0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a</entry>
Aug 01 16:54:19 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:54:19 user nova-compute[72184]:     </system>
Aug 01 16:54:19 user nova-compute[72184]:   </sysinfo>
Aug 01 16:54:19 user nova-compute[72184]:   <os>
Aug 01 16:54:19 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:54:19 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:54:19 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:54:19 user nova-compute[72184]:   </os>
Aug 01 16:54:19 user nova-compute[72184]:   <features>
Aug 01 16:54:19 user nova-compute[72184]:     <acpi/>
Aug 01 16:54:19 user nova-compute[72184]:     <apic/>
Aug 01 16:54:19 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:54:19 user nova-compute[72184]:   </features>
Aug 01 16:54:19 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:54:19 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:54:19 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:54:19 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:54:19 user nova-compute[72184]:   </clock>
Aug 01 16:54:19 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:54:19 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:54:19 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:54:19 user nova-compute[72184]:   </cpu>
Aug 01 16:54:19 user nova-compute[72184]:   <devices>
Aug 01 16:54:19 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:54:19 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:54:19 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk"/>
Aug 01 16:54:19 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:54:19 user nova-compute[72184]:     </disk>
Aug 01 16:54:19 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:54:19 user nova-compute[72184]:       <mac address="fa:16:3e:2e:c1:38"/>
Aug 01 16:54:19 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:54:19 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:54:19 user nova-compute[72184]:       <target dev="tapefd03dca-e0"/>
Aug 01 16:54:19 user nova-compute[72184]:     </interface>
Aug 01 16:54:19 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:54:19 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/console.log" append="off"/>
Aug 01 16:54:19 user nova-compute[72184]:     </serial>
Aug 01 16:54:19 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:54:19 user nova-compute[72184]:     <video>
Aug 01 16:54:19 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:54:19 user nova-compute[72184]:     </video>
Aug 01 16:54:19 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:54:19 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:54:19 user nova-compute[72184]:     </rng>
Aug 01 16:54:19 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:54:19 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:54:19 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:54:19 user nova-compute[72184]:     </memballoon>
Aug 01 16:54:19 user nova-compute[72184]:   </devices>
Aug 01 16:54:19 user nova-compute[72184]: </domain>
Aug 01 16:54:19 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2073617209',display_name='tempest-AttachVolumeNegativeTest-server-2073617209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2073617209',id=15,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIrM/dMD2srrNBXHvHI/RLapeuSotCc8AFLiOoMODsR2ZvNR0hzlC3YZXdHchOw8sLU8d87QVyQhKrogSC98EDmweBqBurlkf+MjAo41bvWq1JO3TM+3EjZ1zjT5hcPqw==',key_name='tempest-keypair-2016280627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-8bdpzxfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG os_vif [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefd03dca-e0, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefd03dca-e0, col_values=(('external_ids', {'iface-id': 'efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:c1:38', 'vm-uuid': '0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:54:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:19 user nova-compute[72184]: INFO os_vif [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0')
Aug 01 16:54:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:2e:c1:38, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:54:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updated VIF entry in instance network info cache for port efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updating instance_info_cache with network_info: [{"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-54deebba-831c-4517-80c7-e3a4acfc8a80 req-3488390c-20d0-4490-824f-894e52f4bc00 service nova] Releasing lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-a14ee20d-3689-4539-ba94-407147d67aa0 req-cd8475ef-5e3a-4e76-9eac-b3b223fadb5a service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a14ee20d-3689-4539-ba94-407147d67aa0 req-cd8475ef-5e3a-4e76-9eac-b3b223fadb5a service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a14ee20d-3689-4539-ba94-407147d67aa0 req-cd8475ef-5e3a-4e76-9eac-b3b223fadb5a service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a14ee20d-3689-4539-ba94-407147d67aa0 req-cd8475ef-5e3a-4e76-9eac-b3b223fadb5a service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-a14ee20d-3689-4539-ba94-407147d67aa0 req-cd8475ef-5e3a-4e76-9eac-b3b223fadb5a service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:21 user nova-compute[72184]: WARNING nova.compute.manager [req-a14ee20d-3689-4539-ba94-407147d67aa0 req-cd8475ef-5e3a-4e76-9eac-b3b223fadb5a service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received unexpected event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with vm_state building and task_state spawning.
Aug 01 16:54:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG nova.objects.instance [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lazy-loading 'flavor' on Instance uuid 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:22 user nova-compute[72184]: INFO nova.compute.manager [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Attaching volume cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc to /dev/sdc
Aug 01 16:54:22 user nova-compute[72184]: DEBUG os_brick.utils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7a59b-099c-4e24-81d1-2c43cbcadae9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96b5c1-a5e0-443c-afcc-b5ce0085c4fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f6b5cf-1d1a-43dc-88c0-4646b6a468b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465dee9-f9a0-459c-9b36-11fbaacff2d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:22 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:54:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec5b962-0c87-4e94-8c25-216b82965b38]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG os_brick.utils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updating existing volume attachment record: 376b4c76-755d-4fcc-ab1e-f231c2ed67c5 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908863.8133621, 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] VM Resumed (Lifecycle Event)
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:54:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Instance spawned successfully.
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-23e6ec4b-c7b4-4f22-9cdc-18deba4e41f2 req-a5253e75-d50f-49c2-a611-80b21994cf19 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-23e6ec4b-c7b4-4f22-9cdc-18deba4e41f2 req-a5253e75-d50f-49c2-a611-80b21994cf19 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-23e6ec4b-c7b4-4f22-9cdc-18deba4e41f2 req-a5253e75-d50f-49c2-a611-80b21994cf19 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-23e6ec4b-c7b4-4f22-9cdc-18deba4e41f2 req-a5253e75-d50f-49c2-a611-80b21994cf19 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-23e6ec4b-c7b4-4f22-9cdc-18deba4e41f2 req-a5253e75-d50f-49c2-a611-80b21994cf19 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:23 user nova-compute[72184]: WARNING nova.compute.manager [req-23e6ec4b-c7b4-4f22-9cdc-18deba4e41f2 req-a5253e75-d50f-49c2-a611-80b21994cf19 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received unexpected event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with vm_state building and task_state spawning.
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908863.820234, 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] VM Started (Lifecycle Event)
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:54:23 user nova-compute[72184]: INFO nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 01 16:54:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:54:24 user nova-compute[72184]: INFO nova.compute.manager [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Took 7.00 seconds to build instance.
Aug 01 16:54:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-68b67d43-118d-4d78-9146-6b5be4484425 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.152s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-changed-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Refreshing instance network info cache due to event network-changed-5142ef5e-1637-4384-ac99-cd294cbeceb0. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] Acquiring lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] Acquired lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Refreshing network info cache for port 5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lazy-loading 'flavor' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:27 user nova-compute[72184]: INFO nova.compute.manager [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Attaching volume 060ef087-4e27-4323-84ed-cc8e22c891a3 to /dev/vdb
Aug 01 16:54:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Updated VIF entry in instance network info cache for port 5142ef5e-1637-4384-ac99-cd294cbeceb0. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Updating instance_info_cache with network_info: [{"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e710e34a-413b-4796-9949-d7f4b70d76bd req-406fd2c2-314c-4117-82d6-ac8c21467891 service nova] Releasing lock "refresh_cache-7896ab2a-6313-459a-b5b9-916929f96970" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG os_brick.utils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37760d7a-299d-493e-8396-0abd5995724b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba02632-9286-49b6-80ce-9706509aa94e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a393d0-3b64-43c2-b806-b0b84ec5b761]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4656d930-5926-47b9-9c76-f782f518c834]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:28 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:54:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[104fedf7-d7d1-4bf7-9ed1-0321f8260328]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG os_brick.utils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Updating existing volume attachment record: 597b1a71-45eb-4485-abb9-be0a50bad9a6 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:54:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'flavor' on Instance uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:54:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Creating image(s)
Aug 01 16:54:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Ensure instance console log exists: /opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Start _get_guest_xml network_info=[{"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '9ecda456-1d8f-4450-9488-bfa5d45f4f56', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9944d144-6f02-4d7b-993d-9d80639dbb76', 'attached_at': '', 'detached_at': '', 'volume_id': 'e024d764-d153-4abd-9082-22daa0510480', 'serial': 'e024d764-d153-4abd-9082-22daa0510480'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:54:30 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:54:30 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:30 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:30 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:30 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f4accb-bbe7-4a35-9289-afa398f42e19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:54:30 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95a9d75-56e1-418d-b9d6-0ae729f18f26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480] added
Aug 01 16:54:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65a4ad-b284-4825-91d4-0df7f7160990]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4352967e-40af-4ea1-ac76-916e16c9dbbe]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNQucFjw {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNQucFjw" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb9135-d320-4af3-9885-9bdf4f42f923]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNQucFjw'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[139670e3-0a74-482d-996a-4c02ad6e9163]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c84a6de-c33d-46ec-b956-cb6f34ea4852]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:30 user nova-compute[72184]: INFO nova.compute.manager [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Attaching volume 93a67a1f-1238-40ae-9e18-a61e4e853aae to /dev/vdb
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5616e086-376d-48b2-a827-cf7fc8e30290]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]
Aug 01 16:54:30 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1863222-2fc4-4642-aaef-04c73f8ec103]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.utils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a33c5-2ed9-4ca1-b0d2-931759dd977d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:30 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24db52e3-8b24-4bfb-86f9-0e905d20668e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[041fa246-3011-4530-b2c7-50edaf21beba]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3867603-b94a-44b8-9727-a5349c989e56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60ace74-28ee-4976-a2b5-4e139472405b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7224d5-798a-4ab1-80c4-f76141abcca6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:30 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:54:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c921745-506d-40ca-a2c5-3b19a77a4b64]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG os_brick.utils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:30 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updating existing volume attachment record: 7fbdc402-74b6-41fa-9aec-a35b94310312 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26562333032646264', 'path': '/dev/sdf'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562333032646264', 'path': '/dev/sdf'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-939615552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-939615552',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKERJF4uaqhkevsOU0CTgv4cvmtOfkduxIFnR4IKMKEFoDveR2Y4WHtOig0qbK7Z3yz4nDK8w978Pm6Z3P1G4EQBHH6UmbCg42YzbkboRMW939x/8GEQInnkfQK23WBviQ==',key_name='tempest-keypair-890600544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-voymav9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=9944d144-6f02-4d7b-993d-9d80639dbb76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'pci_devices' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:54:31 user nova-compute[72184]:   <uuid>9944d144-6f02-4d7b-993d-9d80639dbb76</uuid>
Aug 01 16:54:31 user nova-compute[72184]:   <name>instance-0000000e</name>
Aug 01 16:54:31 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:54:31 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:54:31 user nova-compute[72184]:   <metadata>
Aug 01 16:54:31 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:54:31 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:54:31 user nova-compute[72184]:       <nova:name>tempest-ServerActionsV293TestJSON-server-939615552</nova:name>
Aug 01 16:54:31 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:54:30</nova:creationTime>
Aug 01 16:54:31 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:54:31 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:54:31 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:54:31 user nova-compute[72184]:       <nova:owner>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:user uuid="fe5c17c4d0a84d27ad28486da91673bd">tempest-ServerActionsV293TestJSON-637338544-project-member</nova:user>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:project uuid="0ac23356679f461282fce02ad71f2442">tempest-ServerActionsV293TestJSON-637338544</nova:project>
Aug 01 16:54:31 user nova-compute[72184]:       </nova:owner>
Aug 01 16:54:31 user nova-compute[72184]:       <nova:ports>
Aug 01 16:54:31 user nova-compute[72184]:         <nova:port uuid="415b8e1b-0e0d-4209-b151-4474047270e8">
Aug 01 16:54:31 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 16:54:31 user nova-compute[72184]:         </nova:port>
Aug 01 16:54:31 user nova-compute[72184]:       </nova:ports>
Aug 01 16:54:31 user nova-compute[72184]:     </nova:instance>
Aug 01 16:54:31 user nova-compute[72184]:   </metadata>
Aug 01 16:54:31 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:54:31 user nova-compute[72184]:     <system>
Aug 01 16:54:31 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:54:31 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:54:31 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:54:31 user nova-compute[72184]:       <entry name="serial">9944d144-6f02-4d7b-993d-9d80639dbb76</entry>
Aug 01 16:54:31 user nova-compute[72184]:       <entry name="uuid">9944d144-6f02-4d7b-993d-9d80639dbb76</entry>
Aug 01 16:54:31 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:54:31 user nova-compute[72184]:     </system>
Aug 01 16:54:31 user nova-compute[72184]:   </sysinfo>
Aug 01 16:54:31 user nova-compute[72184]:   <os>
Aug 01 16:54:31 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:54:31 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:54:31 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:54:31 user nova-compute[72184]:   </os>
Aug 01 16:54:31 user nova-compute[72184]:   <features>
Aug 01 16:54:31 user nova-compute[72184]:     <acpi/>
Aug 01 16:54:31 user nova-compute[72184]:     <apic/>
Aug 01 16:54:31 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:54:31 user nova-compute[72184]:   </features>
Aug 01 16:54:31 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:54:31 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:54:31 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:54:31 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:54:31 user nova-compute[72184]:   </clock>
Aug 01 16:54:31 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:54:31 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:54:31 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:54:31 user nova-compute[72184]:   </cpu>
Aug 01 16:54:31 user nova-compute[72184]:   <devices>
Aug 01 16:54:31 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:54:31 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:31 user nova-compute[72184]:       <source dev="/dev/sdf"/>
Aug 01 16:54:31 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:54:31 user nova-compute[72184]:       <serial>e024d764-d153-4abd-9082-22daa0510480</serial>
Aug 01 16:54:31 user nova-compute[72184]:     </disk>
Aug 01 16:54:31 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:54:31 user nova-compute[72184]:       <mac address="fa:16:3e:b3:c4:6a"/>
Aug 01 16:54:31 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:54:31 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:54:31 user nova-compute[72184]:       <target dev="tap415b8e1b-0e"/>
Aug 01 16:54:31 user nova-compute[72184]:     </interface>
Aug 01 16:54:31 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:54:31 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76/console.log" append="off"/>
Aug 01 16:54:31 user nova-compute[72184]:     </serial>
Aug 01 16:54:31 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:54:31 user nova-compute[72184]:     <video>
Aug 01 16:54:31 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:54:31 user nova-compute[72184]:     </video>
Aug 01 16:54:31 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:54:31 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:54:31 user nova-compute[72184]:     </rng>
Aug 01 16:54:31 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:54:31 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:54:31 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:54:31 user nova-compute[72184]:     </memballoon>
Aug 01 16:54:31 user nova-compute[72184]:   </devices>
Aug 01 16:54:31 user nova-compute[72184]: </domain>
Aug 01 16:54:31 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-939615552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-939615552',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKERJF4uaqhkevsOU0CTgv4cvmtOfkduxIFnR4IKMKEFoDveR2Y4WHtOig0qbK7Z3yz4nDK8w978Pm6Z3P1G4EQBHH6UmbCg42YzbkboRMW939x/8GEQInnkfQK23WBviQ==',key_name='tempest-keypair-890600544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-voymav9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=9944d144-6f02-4d7b-993d-9d80639dbb76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG os_vif [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap415b8e1b-0e, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap415b8e1b-0e, col_values=(('external_ids', {'iface-id': '415b8e1b-0e0d-4209-b151-4474047270e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:c4:6a', 'vm-uuid': '9944d144-6f02-4d7b-993d-9d80639dbb76'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:31 user nova-compute[72184]: INFO os_vif [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e')
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] No VIF found with MAC fa:16:3e:b3:c4:6a, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QADvjsMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:32 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:32 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:32 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d4c423-d328-4cd5-a395-a4af59266f58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:54:32 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b7197-7c23-4b14-a4d8-f499a481d183]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc] added
Aug 01 16:54:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b338f14-45d1-441a-91e5-50ff806a8537]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5879eb5-059e-4298-b86e-6f58b4a19bdf]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QADvjsMI {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QADvjsMI" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f856ff-b758-4b91-acbb-a14e854dfd32]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QADvjsMI'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae96f68d-6594-4d76-82f3-7b6e6c1384d7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f98e6a-2dc1-47df-8128-b0bdff1e2318]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7d0b6-3035-4375-9928-c3cb4df2e4e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260]
Aug 01 16:54:32 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb695d2-8d73-4cd2-ae13-ebe05e92e2ca]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ec8d5-c4a9-4e14-9be0-579bb88e2242]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc (non-flash)
Aug 01 16:54:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:32 user nova-compute[72184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc (non-flash)
Aug 01 16:54:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[339e9add-69d3-4c8b-bc04-69f934a3dde4]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:54:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QADvjsMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-bc134073-4d42-4644-8836-e7943771e6dc req-6d980a0b-0f92-4bc0-a317-6b0851385010 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bc134073-4d42-4644-8836-e7943771e6dc req-6d980a0b-0f92-4bc0-a317-6b0851385010 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bc134073-4d42-4644-8836-e7943771e6dc req-6d980a0b-0f92-4bc0-a317-6b0851385010 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bc134073-4d42-4644-8836-e7943771e6dc req-6d980a0b-0f92-4bc0-a317-6b0851385010 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-bc134073-4d42-4644-8836-e7943771e6dc req-6d980a0b-0f92-4bc0-a317-6b0851385010 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:33 user nova-compute[72184]: WARNING nova.compute.manager [req-bc134073-4d42-4644-8836-e7943771e6dc req-6d980a0b-0f92-4bc0-a317-6b0851385010 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state building and task_state spawning.
Aug 01 16:54:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26334306636396466', 'path': '/dev/sdg'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334306636396466', 'path': '/dev/sdg'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lazy-loading 'flavor' on Instance uuid 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:54:33 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:33 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 16:54:33 user nova-compute[72184]:   <target dev="sdc" bus="scsi"/>
Aug 01 16:54:33 user nova-compute[72184]:   <serial>cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc</serial>
Aug 01 16:54:33 user nova-compute[72184]:   <address type="drive" controller="0" unit="2"/>
Aug 01 16:54:33 user nova-compute[72184]: </disk>
Aug 01 16:54:33 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No BDM found with device name sda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] No VIF found with MAC fa:16:3e:c4:db:49, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:54:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58fac023-7696-4147-b594-44c307d1df21 tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.274s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:34 user nova-compute[72184]: INFO nova.compute.manager [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Detaching volume cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc
Aug 01 16:54:34 user nova-compute[72184]: INFO nova.virt.block_device [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Attempting to driver detach volume cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc from mountpoint /dev/sdc
Aug 01 16:54:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Attempting to detach device sdc from instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:54:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:54:34 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:34 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 16:54:34 user nova-compute[72184]:   <target dev="sdc" bus="scsi"/>
Aug 01 16:54:34 user nova-compute[72184]:   <serial>cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc</serial>
Aug 01 16:54:34 user nova-compute[72184]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 16:54:34 user nova-compute[72184]: </disk>
Aug 01 16:54:34 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:54:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Successfully detached device sdc from instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 from the persistent domain config.
Aug 01 16:54:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:54:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:54:34 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:34 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 16:54:34 user nova-compute[72184]:   <target dev="sdc" bus="scsi"/>
Aug 01 16:54:34 user nova-compute[72184]:   <serial>cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc</serial>
Aug 01 16:54:34 user nova-compute[72184]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 16:54:34 user nova-compute[72184]: </disk>
Aug 01 16:54:34 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690908875.233678, 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Successfully detached device sdc from instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 from the live domain config.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QADvjsMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:35 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5bb42-3c4b-4de6-95e7-fb49742794cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e7d92-af2f-490c-9cc1-a93255577f1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc (non-flash)
Aug 01 16:54:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:35 user nova-compute[72184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc (non-flash)
Aug 01 16:54:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30279a40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc'): ({'sdg'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Removing single pathed devices sdg {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65857be-5b86-46c9-9938-3ef7a1dd1017]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[71391a45-33bf-4e2b-9daa-ea1a091a141c]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Flushing IO for device /dev/sdg {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e64bd-76b0-4319-b824-3ae6e61b615c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-529d14a6-88e9-4630-87e5-79ae27a2e38b req-0dabe06d-7291-4297-b6da-ec16d2153a91 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-529d14a6-88e9-4630-87e5-79ae27a2e38b req-0dabe06d-7291-4297-b6da-ec16d2153a91 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-529d14a6-88e9-4630-87e5-79ae27a2e38b req-0dabe06d-7291-4297-b6da-ec16d2153a91 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-529d14a6-88e9-4630-87e5-79ae27a2e38b req-0dabe06d-7291-4297-b6da-ec16d2153a91 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-529d14a6-88e9-4630-87e5-79ae27a2e38b req-0dabe06d-7291-4297-b6da-ec16d2153a91 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:35 user nova-compute[72184]: WARNING nova.compute.manager [req-529d14a6-88e9-4630-87e5-79ae27a2e38b req-0dabe06d-7291-4297-b6da-ec16d2153a91 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state building and task_state spawning.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908875.4080162, 9944d144-6f02-4d7b-993d-9d80639dbb76 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] VM Resumed (Lifecycle Event)
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c28a8-a87c-46b4-84d5-4e316fe9151d]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff09c1a-d9ba-488b-946e-4e2267929cba]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance spawned successfully.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908875.409063, 9944d144-6f02-4d7b-993d-9d80639dbb76 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] VM Started (Lifecycle Event)
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15114547-350f-4f16-b216-21f4476c8f29]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260]
Aug 01 16:54:35 user nova-compute[72184]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3ffd0e-798e-441d-8d27-8f5ecd2f05bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1751b044-79f3-4e1a-beef-d0afe7a93981]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] <== disconnect_volume: return (322ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:35 user nova-compute[72184]: INFO nova.compute.manager [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Took 27.35 seconds to build instance.
Aug 01 16:54:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1eda206d-6589-43e0-a62d-2b316e2a82fa tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.475s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lazy-loading 'flavor' on Instance uuid 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-beb560db-a63f-477d-b00f-f7ac418e629f tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.681s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:36 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:36 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:36 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc03f76d-5fc8-4f08-8ed5-8ef6df7a0cee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:54:36 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ca923-ac82-4f5d-904b-2cb057631586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3] added
Aug 01 16:54:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6060d9f-f73c-4dd9-91e3-4f4abbd99788]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2140f70a-4429-427d-baee-2d0974f1d4a9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdaWGLNq {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdaWGLNq" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b40e62a-2c34-4c32-93cb-f0785c666b2e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YdaWGLNq'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee289bd-9f21-4101-8cba-3b5a96f86075]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e296b2-8ccb-4f3b-99cf-a8beb948b708]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:36 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147ea7c-b65b-40a7-b3ee-b760e7416d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]
Aug 01 16:54:37 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:37 user nova-compute[72184]: INFO nova.compute.manager [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Terminating instance
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a228ae9-51de-4480-a914-f14a37089519]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0abdd29-0722-4a91-b131-8cf1fef30365]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74eb563-5bec-41b7-8433-9c1cbfc52d39]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-29915678-4bf1-40fa-af97-37f727268599 req-d26a7372-7f36-40bf-806b-40246790492a service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-vif-unplugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-29915678-4bf1-40fa-af97-37f727268599 req-d26a7372-7f36-40bf-806b-40246790492a service nova] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-29915678-4bf1-40fa-af97-37f727268599 req-d26a7372-7f36-40bf-806b-40246790492a service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-29915678-4bf1-40fa-af97-37f727268599 req-d26a7372-7f36-40bf-806b-40246790492a service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-29915678-4bf1-40fa-af97-37f727268599 req-d26a7372-7f36-40bf-806b-40246790492a service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] No waiting events found dispatching network-vif-unplugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-29915678-4bf1-40fa-af97-37f727268599 req-d26a7372-7f36-40bf-806b-40246790492a service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-vif-unplugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Instance destroyed successfully.
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lazy-loading 'resources' on Instance uuid 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1098537382',display_name='tempest-AttachSCSIVolumeTestJSON-server-1098537382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1098537382',id=9,image_ref='e110e3b1-80fa-4bb0-8638-513de5f6a8ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOC72tup+DCAJHhoHmArMLchyNAqdnzgqUeMw7GHPmQil1Yn5zVOweMzgKthv0iQ7AQ8oSOmqrpU7vA+6NcTwtrrAkSZ9miMpkRFi+BYH7O/bs6aZxfiWnQeyEiLPFsNQ==',key_name='tempest-keypair-1696491998',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='534dff85f9514a65965377871103e1e4',ramdisk_id='',reservation_id='r-oyfkqbpq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e110e3b1-80fa-4bb0-8638-513de5f6a8ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-135251302',owner_user_name='tempest-AttachSCSIVolumeTestJSON-135251302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87601f29198d46f59297c49d288cdee0',uuid=7e039a15-ad7b-4667-b0fb-002c6d9b4ab0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Converting VIF {"id": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "address": "fa:16:3e:c4:db:49", "network": {"id": "e3f4f202-645a-4a8a-a9fc-bc350f5b8d77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-100667751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534dff85f9514a65965377871103e1e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161ebe17-3c", "ovs_interfaceid": "161ebe17-3cae-4663-885d-2fa0cee0f8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG os_vif [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap161ebe17-3c, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:37 user nova-compute[72184]: INFO os_vif [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:db:49,bridge_name='br-int',has_traffic_filtering=True,id=161ebe17-3cae-4663-885d-2fa0cee0f8d8,network=Network(e3f4f202-645a-4a8a-a9fc-bc350f5b8d77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161ebe17-3c')
Aug 01 16:54:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Deleting instance files /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0_del
Aug 01 16:54:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Deletion of /opt/stack/data/nova/instances/7e039a15-ad7b-4667-b0fb-002c6d9b4ab0_del complete
Aug 01 16:54:38 user nova-compute[72184]: INFO nova.compute.manager [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 01 16:54:38 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26236636461306564', 'path': '/dev/sdg'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236636461306564', 'path': '/dev/sdg'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lazy-loading 'flavor' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:54:38 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:38 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 16:54:38 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:54:38 user nova-compute[72184]:   <serial>060ef087-4e27-4323-84ed-cc8e22c891a3</serial>
Aug 01 16:54:38 user nova-compute[72184]: </disk>
Aug 01 16:54:38 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] No VIF found with MAC fa:16:3e:79:43:32, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:54:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fd24f44d-c37d-4d7d-aee7-ba24fd48d2a8 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.062s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:39 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Took 1.32 seconds to deallocate network for instance.
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-d03c6382-ce0a-45d2-96f8-f4b07fda5f4b req-e359aa29-4195-4c7e-9d8f-ba09290366f9 service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-vif-deleted-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrCHOKhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:39 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:39 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:39 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffee51c8-4e40-42c6-aa7a-996b58eee661]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:54:39 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1020e5c2-37a7-4803-8974-7d8adb9eb315]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae] added
Aug 01 16:54:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217db6b-a0c8-47ed-b003-c3f26c36a7d6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462338c-1a32-44b5-9df6-a45462cb017e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrCHOKhd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-10e776b0-6df0-49a3-adc3-c3e86313224a req-af9870ab-0263-4f25-9cb0-8da91f32d7df service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received event network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-10e776b0-6df0-49a3-adc3-c3e86313224a req-af9870ab-0263-4f25-9cb0-8da91f32d7df service nova] Acquiring lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-10e776b0-6df0-49a3-adc3-c3e86313224a req-af9870ab-0263-4f25-9cb0-8da91f32d7df service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-10e776b0-6df0-49a3-adc3-c3e86313224a req-af9870ab-0263-4f25-9cb0-8da91f32d7df service nova] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-10e776b0-6df0-49a3-adc3-c3e86313224a req-af9870ab-0263-4f25-9cb0-8da91f32d7df service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] No waiting events found dispatching network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:54:39 user nova-compute[72184]: WARNING nova.compute.manager [req-10e776b0-6df0-49a3-adc3-c3e86313224a req-af9870ab-0263-4f25-9cb0-8da91f32d7df service nova] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Received unexpected event network-vif-plugged-161ebe17-3cae-4663-885d-2fa0cee0f8d8 for instance with vm_state deleted and task_state None.
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrCHOKhd" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[386e1a7b-dde8-4569-b737-19454698cd9a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrCHOKhd'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc516e-3d33-4ffe-a40f-c80b240aaaf8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a443a6-e11e-4c46-ad32-b57ebd114fcb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06648309-187d-456b-aee3-360d727f5a0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260]
Aug 01 16:54:39 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cdb9c-3812-468e-8d61-9c440837e3d8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4340610-6c15-4ac4-87aa-b5c216d3d160]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae (non-flash)
Aug 01 16:54:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:39 user nova-compute[72184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae (non-flash)
Aug 01 16:54:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[497fa894-c3ca-4a79-929f-3f4a14158da3]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrCHOKhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:54:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:39 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Deleted allocations for instance 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-74598658-8781-4bdc-b597-5020081c76ed tempest-AttachSCSIVolumeTestJSON-135251302 tempest-AttachSCSIVolumeTestJSON-135251302-project-member] Lock "7e039a15-ad7b-4667-b0fb-002c6d9b4ab0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.979s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.utils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317142e-d2f3-418c-8043-9142062b67af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad0a8fa-852c-43a2-8fe3-38b743618197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be18b998-ef88-4ccd-aa4a-dc7d78804c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b30fe89-ce5b-4a10-9ffe-2a20f79b804a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:40 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:54:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c19e85-ea0d-4645-953f-b1c14415d06f]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.utils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:40 user nova-compute[72184]: INFO nova.compute.manager [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Swapping volume 060ef087-4e27-4323-84ed-cc8e22c891a3 for 0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26166333236616538', 'path': '/dev/sdh'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166333236616538', 'path': '/dev/sdh'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'flavor' on Instance uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:54:40 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:40 user nova-compute[72184]:   <source dev="/dev/sdh"/>
Aug 01 16:54:40 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:54:40 user nova-compute[72184]:   <serial>93a67a1f-1238-40ae-9e18-a61e4e853aae</serial>
Aug 01 16:54:40 user nova-compute[72184]: </disk>
Aug 01 16:54:40 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:54:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:54:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No VIF found with MAC fa:16:3e:3a:4a:d9, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:54:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b322fc00-f498-41bc-9426-6e0fa0a9883d tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.148s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:42 user nova-compute[72184]: INFO nova.compute.manager [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Detaching volume 93a67a1f-1238-40ae-9e18-a61e4e853aae
Aug 01 16:54:42 user nova-compute[72184]: INFO nova.virt.block_device [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Attempting to driver detach volume 93a67a1f-1238-40ae-9e18-a61e4e853aae from mountpoint /dev/vdb
Aug 01 16:54:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Attempting to detach device vdb from instance 70e188c4-72bc-4842-bb3f-a9d611c38164 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:54:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:54:42 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:42 user nova-compute[72184]:   <source dev="/dev/sdh"/>
Aug 01 16:54:42 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:54:42 user nova-compute[72184]:   <serial>93a67a1f-1238-40ae-9e18-a61e4e853aae</serial>
Aug 01 16:54:42 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:54:42 user nova-compute[72184]: </disk>
Aug 01 16:54:42 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:54:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Successfully detached device vdb from instance 70e188c4-72bc-4842-bb3f-a9d611c38164 from the persistent domain config.
Aug 01 16:54:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70e188c4-72bc-4842-bb3f-a9d611c38164 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:54:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:54:42 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:54:42 user nova-compute[72184]:   <source dev="/dev/sdh"/>
Aug 01 16:54:42 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:54:42 user nova-compute[72184]:   <serial>93a67a1f-1238-40ae-9e18-a61e4e853aae</serial>
Aug 01 16:54:42 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:54:42 user nova-compute[72184]: </disk>
Aug 01 16:54:42 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:54:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690908883.3379517, 70e188c4-72bc-4842-bb3f-a9d611c38164 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:54:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Successfully detached device vdb from instance 70e188c4-72bc-4842-bb3f-a9d611c38164 from the live domain config.
Aug 01 16:54:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrCHOKhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:43 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c875c70f-1613-46a7-b75c-ef877953e938]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3605ac80-ed21-4bc2-b699-f80b29deed61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae (non-flash)
Aug 01 16:54:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:43 user nova-compute[72184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae (non-flash)
Aug 01 16:54:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301865ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae'): ({'sdh'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Removing single pathed devices sdh {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0948a7c-caf8-41dd-bcef-0b5c58408c7a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa92a2-50a4-46bf-a5f7-9b9a3b4e9a5b]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Flushing IO for device /dev/sdh {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0752d37a-8e10-45c0-93d5-e7b5d312f3ba]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c28de-1713-4dd5-9c1f-e6266819cfa6]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] SCSI volumes sdh have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac8b8a-acb6-4dfa-bbdc-1c05c04576f6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f3ead-46fd-4781-a851-bcdf564f5118]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260]
Aug 01 16:54:43 user nova-compute[72184]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93a67a1f-1238-40ae-9e18-a61e4e853aae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30110d7-5eef-4f8c-abdc-ddea5e780bda]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] <== disconnect_volume: return (321ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:54:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'flavor' on Instance uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8606c0d2-1283-4c42-906b-cdacd3341247 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBdrZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7896ab2a-6313-459a-b5b9-916929f96970', 'attached_at': '', 'detached_at': '', 'volume_id': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4', 'serial': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7896ab2a-6313-459a-b5b9-916929f96970', 'attached_at': '', 'detached_at': '', 'volume_id': '060ef087-4e27-4323-84ed-cc8e22c891a3', 'serial'} {{(pid=72184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBdrZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:48 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:48 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:48 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:54:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[200acef7-a9fa-46ab-92b0-96da950d1b17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:54:49 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e25662-8f89-45d0-bfa7-227f2bdc4420]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4] added
Aug 01 16:54:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70ab98-c7e3-4ae4-a309-f00027aa9a54]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbcdf0c-967b-4f70-b0fa-f4529726ebb8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naBdrZpt {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naBdrZpt" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ed78a-c202-44a6-823a-04be89ef99c5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'naBdrZpt'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc0b10b-a025-4889-9aaa-7bc986ec84ab]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa6cfdb-fc22-40d4-9603-bc2d15413e57]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb589178-c9fe-4353-9ac5-061a6d1f7201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260]
Aug 01 16:54:49 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a73241-958c-48ff-b706-2bbb2c20a245]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ffd156-018a-4c8b-800d-69c52b5032c9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d087b85-1f76-40f9-8373-4bdbbe4a859c]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBdrZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23431303536313434', 'path': '/dev/sdh'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431303536313434', 'path': '/dev/sdh'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:54:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:54:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=6365MB free_disk=25.389415740966797GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lazy-loading 'flavor' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7b407b54-6887-4b20-a3ae-50a2ce5777be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 70e188c4-72bc-4842-bb3f-a9d611c38164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7896ab2a-6313-459a-b5b9-916929f96970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 04d3b87c-2cec-499c-9972-b99310f6751f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 9944d144-6f02-4d7b-993d-9d80639dbb76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:54:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:54:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:54:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:54:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 76546048 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 247463936 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updating instance_info_cache with network_info: [{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908877.9166732, 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:54:52 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] VM Stopped (Lifecycle Event)
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c135135b-7bf0-4531-8287-c42afbb22267 None None] [instance: 7e039a15-ad7b-4667-b0fb-002c6d9b4ab0] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:54:54 user nova-compute[72184]: INFO nova.compute.claims [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Claim successful on node user
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:54 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7acf46f-9909-4bda-b73e-908bc3e588d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6689c0-077d-4da9-978b-cae96d4093f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:54:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301815f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'): ({'sdg'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Removing single pathed devices sdg {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb7f72b-da49-43ac-ab41-e98a9306c1a4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee526bd9-9171-4d71-90bf-14838d89c33c]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Flushing IO for device /dev/sdg {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe8361-0e5e-4e88-b7fc-17fdc626bfe9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f672e-ca11-406c-8d0e-ea3dbaaaad7a]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6608b22-791b-4ff0-a33d-e1584a68f276]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4bdf6c-5984-49d7-baa5-dbc016d60f9f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]
Aug 01 16:54:54 user nova-compute[72184]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.
Aug 01 16:54:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cb128b-cc29-4bd6-889a-eef64f5dc50c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] <== disconnect_volume: return (305ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBdrZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '7896ab2a-6313-459a-b5b9-916929f96970', 'attached_at': '', 'detached_at': '', 'volume_id': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4', 'serial'} {{(pid=72184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] swap_volume: removing Cinder connection for volume 060ef087-4e27-4323-84ed-cc8e22c891a3 {{(pid=72184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 16:54:54 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:54:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:54:55 user nova-compute[72184]: INFO nova.virt.block_device [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Booting with blank volume at /dev/vda
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.policy [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9ae86640754099bb01c48a6807075f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13772bce6fa482189f819cb065170b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Successfully created port: 0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] swap_volume: Updating volume 060ef087-4e27-4323-84ed-cc8e22c891a3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "naBdrZpt", "auth_password": "1sSbo0VWzNT5Pi", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4"}, "status": "reserved", "instance": "7896ab2a-6313-459a-b5b9-916929f96970", "attached_at": "", "detached_at": "", "volume_id": "0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4", "serial": "0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4', 'no_device': None, 'attachment_id': '36b03d9d-264d-43d9-9e81-7015d63aab02'} {{(pid=72184) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 16:54:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8588d43-4fc0-4fac-9208-68b3cae5d035 tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.418s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Successfully updated port: 0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-changed-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Refreshing instance network info cache due to event network-changed-0bb757b6-8cb4-4a5b-986f-3299f6cc5265. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] Acquiring lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:54:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance network_info: |[{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] Acquired lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Refreshing network info cache for port 0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG os_brick.utils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155540f-c098-4942-ad5e-d7cb9e23ad2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fcda8f-cc22-434f-8dae-e6aa4c58df9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba1436-08ae-489c-b141-39fdec1f1c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[373da6e5-af8f-4709-a9a7-b9e0fbd1608b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:54:57 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de19e68-4c17-4d29-b5e2-8661e72b936c]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG os_brick.utils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:54:57 user nova-compute[72184]: INFO nova.compute.manager [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Swapping volume 0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 for 060ef087-4e27-4323-84ed-cc8e22c891a3
Aug 01 16:54:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updated VIF entry in instance network info cache for port 0bb757b6-8cb4-4a5b-986f-3299f6cc5265. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d95de6cc-d069-4c10-9072-40825af238c8 req-3f7f8250-9cd4-4c82-9127-3f222bfef980 service nova] Releasing lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:54:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:54:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG os_brick.utils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd47cc28-0213-4bdb-b76e-96883602681c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b472fd9-053e-4e7d-9c8a-98a42e1404dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54770e3c-dc69-4737-b777-044b50fc4dc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f6ab9-b247-4d11-85be-4b1eb5738cf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:55:00 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:55:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfa9eb0-da27-4b5b-bc00-d148c52f48fa]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG os_brick.utils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:00 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating existing volume attachment record: 98119b81-8843-4e04-98e3-492f2764dcf9 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:55:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7896ab2a-6313-459a-b5b9-916929f96970', 'attached_at': '', 'detached_at': '', 'volume_id': '060ef087-4e27-4323-84ed-cc8e22c891a3', 'serial': '060ef087-4e27-4323-84ed-cc8e22c891a3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBdrZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'}, 'status': 'reserved', 'instance': '7896ab2a-6313-459a-b5b9-916929f96970', 'attached_at': '', 'detached_at': '', 'volume_id': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4', 'serial'} {{(pid=72184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:05 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba44cd-dcf4-4452-804c-8a622796ec3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:55:05 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3aeea-ea64-42f7-b445-eaaf81c8e898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3] added
Aug 01 16:55:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43578fb-304a-4cb2-bed9-f36bb9db701d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b5e83b-fb33-4cad-8ed9-6653c6444222]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdaWGLNq {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdaWGLNq" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5574bada-bbb7-442e-ab0e-5ffe13c8ee55]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YdaWGLNq'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e285951-c873-4099-8643-8521232cd074]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68701d2-ec2d-481d-9424-1c740259215a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:05 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82012a69-aa6f-4f08-a959-f6f1f7f26819]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]
Aug 01 16:55:06 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:06 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c315c57-18e8-4ef3-995a-7103881445fc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b964ad-b97e-42ff-840b-ae735ba220d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:06 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:06 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f6c6b-a444-4f5d-bcee-1e2d31727843]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:06 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26236636461306564', 'path': '/dev/sdg'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236636461306564', 'path': '/dev/sdg'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lazy-loading 'flavor' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 285212672 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 404750336 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-changed-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing instance network info cache due to event network-changed-13d4efe4-5871-4e5f-b474-5df9ffb1339a. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] Acquiring lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] Acquired lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Refreshing network info cache for port 13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 470810624 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:55:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Creating image(s)
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Ensure instance console log exists: /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Start _get_guest_xml network_info=[{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '98119b81-8843-4e04-98e3-492f2764dcf9', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69c7aebb-9797-4347-8f0c-ce5c175629e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a22608d4-9439-4d52-b66b-f5d9150027dc', 'serial': 'a22608d4-9439-4d52-b66b-f5d9150027dc'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:55:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:55:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:09 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[937554a0-b7ee-48e3-aca2-d0a8c32b6a89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:55:09 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f8d5f1-13f8-4371-8439-3ccd5bec75da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc] added
Aug 01 16:55:10 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb076019-9ceb-4506-a891-d2fe3cdaf7d1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56a085c-c283-44b5-a53b-db140b6ac50a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJAsRMwf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJAsRMwf" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7071cc-6009-42af-ac6e-19ccdba5cc8a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TJAsRMwf'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updated VIF entry in instance network info cache for port 13d4efe4-5871-4e5f-b474-5df9ffb1339a. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7bfe6-08ea-4a4f-b8d3-c1abd7e544fa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-08807900-e66e-429f-9a54-fc2f7b7fe12b req-b824bcd9-8aa6-4db1-ac8e-deb20230d340 service nova] Releasing lock "refresh_cache-01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 632291328 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2214ef-3a4e-4e24-991a-65dbc384a4e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[da300768-bd09-49f2-aa02-55a1b69e580c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260]
Aug 01 16:55:10 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:10 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c299f-4772-464a-94ce-6dbc19236fa2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132cd87-9837-43c1-a783-01d6577e138d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:10 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:10 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b08017e-3616-4d5e-87f0-561d0662fd78]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:55:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 831520768 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 998244352 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26230323930643239', 'path': '/dev/sdi'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230323930643239', 'path': '/dev/sdi'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-18467087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-18467087',id=16,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-kbqzxqu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:55Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=69c7aebb-9797-4347-8f0c-ce5c175629e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'pci_devices' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:55:11 user nova-compute[72184]:   <uuid>69c7aebb-9797-4347-8f0c-ce5c175629e2</uuid>
Aug 01 16:55:11 user nova-compute[72184]:   <name>instance-00000010</name>
Aug 01 16:55:11 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:55:11 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:55:11 user nova-compute[72184]:   <metadata>
Aug 01 16:55:11 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:55:11 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:55:11 user nova-compute[72184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-18467087</nova:name>
Aug 01 16:55:11 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:55:09</nova:creationTime>
Aug 01 16:55:11 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:55:11 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:55:11 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:55:11 user nova-compute[72184]:       <nova:owner>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:user uuid="1b9ae86640754099bb01c48a6807075f">tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member</nova:user>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:project uuid="b13772bce6fa482189f819cb065170b3">tempest-ServerBootFromVolumeStableRescueTest-388641611</nova:project>
Aug 01 16:55:11 user nova-compute[72184]:       </nova:owner>
Aug 01 16:55:11 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:55:11 user nova-compute[72184]:       <nova:ports>
Aug 01 16:55:11 user nova-compute[72184]:         <nova:port uuid="0bb757b6-8cb4-4a5b-986f-3299f6cc5265">
Aug 01 16:55:11 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 16:55:11 user nova-compute[72184]:         </nova:port>
Aug 01 16:55:11 user nova-compute[72184]:       </nova:ports>
Aug 01 16:55:11 user nova-compute[72184]:     </nova:instance>
Aug 01 16:55:11 user nova-compute[72184]:   </metadata>
Aug 01 16:55:11 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:55:11 user nova-compute[72184]:     <system>
Aug 01 16:55:11 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:55:11 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:55:11 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:55:11 user nova-compute[72184]:       <entry name="serial">69c7aebb-9797-4347-8f0c-ce5c175629e2</entry>
Aug 01 16:55:11 user nova-compute[72184]:       <entry name="uuid">69c7aebb-9797-4347-8f0c-ce5c175629e2</entry>
Aug 01 16:55:11 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:55:11 user nova-compute[72184]:     </system>
Aug 01 16:55:11 user nova-compute[72184]:   </sysinfo>
Aug 01 16:55:11 user nova-compute[72184]:   <os>
Aug 01 16:55:11 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:55:11 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:55:11 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:55:11 user nova-compute[72184]:   </os>
Aug 01 16:55:11 user nova-compute[72184]:   <features>
Aug 01 16:55:11 user nova-compute[72184]:     <acpi/>
Aug 01 16:55:11 user nova-compute[72184]:     <apic/>
Aug 01 16:55:11 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:55:11 user nova-compute[72184]:   </features>
Aug 01 16:55:11 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:55:11 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:55:11 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:55:11 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:55:11 user nova-compute[72184]:   </clock>
Aug 01 16:55:11 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:55:11 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:55:11 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:55:11 user nova-compute[72184]:   </cpu>
Aug 01 16:55:11 user nova-compute[72184]:   <devices>
Aug 01 16:55:11 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:55:11 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:55:11 user nova-compute[72184]:       <source dev="/dev/sdi"/>
Aug 01 16:55:11 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:55:11 user nova-compute[72184]:       <serial>a22608d4-9439-4d52-b66b-f5d9150027dc</serial>
Aug 01 16:55:11 user nova-compute[72184]:     </disk>
Aug 01 16:55:11 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:55:11 user nova-compute[72184]:       <mac address="fa:16:3e:2a:08:cd"/>
Aug 01 16:55:11 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:55:11 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:55:11 user nova-compute[72184]:       <target dev="tap0bb757b6-8c"/>
Aug 01 16:55:11 user nova-compute[72184]:     </interface>
Aug 01 16:55:11 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:55:11 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/console.log" append="off"/>
Aug 01 16:55:11 user nova-compute[72184]:     </serial>
Aug 01 16:55:11 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:55:11 user nova-compute[72184]:     <video>
Aug 01 16:55:11 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:55:11 user nova-compute[72184]:     </video>
Aug 01 16:55:11 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:55:11 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:55:11 user nova-compute[72184]:     </rng>
Aug 01 16:55:11 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:55:11 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:55:11 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:55:11 user nova-compute[72184]:     </memballoon>
Aug 01 16:55:11 user nova-compute[72184]:   </devices>
Aug 01 16:55:11 user nova-compute[72184]: </domain>
Aug 01 16:55:11 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-18467087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-18467087',id=16,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-kbqzxqu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:55Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=69c7aebb-9797-4347-8f0c-ce5c175629e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_vif [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb757b6-8c, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bb757b6-8c, col_values=(('external_ids', {'iface-id': '0bb757b6-8cb4-4a5b-986f-3299f6cc5265', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:08:cd', 'vm-uuid': '69c7aebb-9797-4347-8f0c-ce5c175629e2'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:11 user nova-compute[72184]: INFO os_vif [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c')
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No VIF found with MAC fa:16:3e:2a:08:cd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBdrZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[882bf2cd-c689-4fff-82c3-f6e7ead34ad1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:11 user nova-compute[72184]: INFO nova.compute.manager [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Terminating instance
Aug 01 16:55:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f61f7-fa67-4f4f-a570-660663fd05e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:11 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301815f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4'): ({'sdh'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Removing single pathed devices sdh {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8c4aa9-c093-4612-8112-007da4274f8d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e3a1e6-11ca-404f-b53d-ab489651c635]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Flushing IO for device /dev/sdh {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[251b3f89-253d-45a7-b35f-51b6fd3b0522]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ab763-d723-4c2a-8762-182d05679cf3]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] SCSI volumes sdh have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4066a62-6a8c-4d11-aa8d-fa39e03df926]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.148s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920f2c5-214e-4b77-be39-53dcd3175f4b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260]
Aug 01 16:55:12 user nova-compute[72184]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:12 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-dbf28a8e-6f9a-4c83-ab36-ada016a739f8 req-1744b4b3-07fb-4075-b2c5-404b9d90a15b service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dbf28a8e-6f9a-4c83-ab36-ada016a739f8 req-1744b4b3-07fb-4075-b2c5-404b9d90a15b service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dbf28a8e-6f9a-4c83-ab36-ada016a739f8 req-1744b4b3-07fb-4075-b2c5-404b9d90a15b service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dbf28a8e-6f9a-4c83-ab36-ada016a739f8 req-1744b4b3-07fb-4075-b2c5-404b9d90a15b service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-dbf28a8e-6f9a-4c83-ab36-ada016a739f8 req-1744b4b3-07fb-4075-b2c5-404b9d90a15b service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-dbf28a8e-6f9a-4c83-ab36-ada016a739f8 req-1744b4b3-07fb-4075-b2c5-404b9d90a15b service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc0b5e-f412-455b-b8b4-7abb75b7fece]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] <== disconnect_volume: return (411ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7896ab2a-6313-459a-b5b9-916929f96970', 'attached_at': '', 'detached_at': '', 'volume_id': '060ef087-4e27-4323-84ed-cc8e22c891a3', 'serial'} {{(pid=72184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] swap_volume: removing Cinder connection for volume 0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 {{(pid=72184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-758b8cbc-8efe-4702-8ac2-fb0b9c42406b req-c55601f6-d07c-4a6a-ba8e-4e060e41372d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-758b8cbc-8efe-4702-8ac2-fb0b9c42406b req-c55601f6-d07c-4a6a-ba8e-4e060e41372d service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-758b8cbc-8efe-4702-8ac2-fb0b9c42406b req-c55601f6-d07c-4a6a-ba8e-4e060e41372d service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-758b8cbc-8efe-4702-8ac2-fb0b9c42406b req-c55601f6-d07c-4a6a-ba8e-4e060e41372d service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-758b8cbc-8efe-4702-8ac2-fb0b9c42406b req-c55601f6-d07c-4a6a-ba8e-4e060e41372d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-758b8cbc-8efe-4702-8ac2-fb0b9c42406b req-c55601f6-d07c-4a6a-ba8e-4e060e41372d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-378f52b5-5a53-48f8-b3ef-732cc9126be2 req-28266011-e531-464b-a6d7-92c20a46495c service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-378f52b5-5a53-48f8-b3ef-732cc9126be2 req-28266011-e531-464b-a6d7-92c20a46495c service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-378f52b5-5a53-48f8-b3ef-732cc9126be2 req-28266011-e531-464b-a6d7-92c20a46495c service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-378f52b5-5a53-48f8-b3ef-732cc9126be2 req-28266011-e531-464b-a6d7-92c20a46495c service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-378f52b5-5a53-48f8-b3ef-732cc9126be2 req-28266011-e531-464b-a6d7-92c20a46495c service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-378f52b5-5a53-48f8-b3ef-732cc9126be2 req-28266011-e531-464b-a6d7-92c20a46495c service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-ca101cc4-7cea-43c7-ada1-01298a576185 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] swap_volume: Updating volume 0cd1ee55-5d9d-4547-bdb5-dbcbc9b2bdd4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "YdaWGLNq", "auth_password": "SkM4dFbPx3r0qZ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "060ef087-4e27-4323-84ed-cc8e22c891a3"}, "status": "reserved", "instance": "7896ab2a-6313-459a-b5b9-916929f96970", "attached_at": "", "detached_at": "", "volume_id": "060ef087-4e27-4323-84ed-cc8e22c891a3", "serial": "060ef087-4e27-4323-84ed-cc8e22c891a3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '060ef087-4e27-4323-84ed-cc8e22c891a3', 'no_device': None, 'attachment_id': '9631d8bd-a111-4a8a-83c4-21f8d8585b7e'} {{(pid=72184) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c8ad0714-cb82-4b3f-a173-433ae089970d tempest-TestVolumeSwap-1593249873 tempest-TestVolumeSwap-1593249873-project-admin] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.341s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Instance destroyed successfully.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.objects.instance [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lazy-loading 'resources' on Instance uuid 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13d4efe4-58, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=13d4efe4-5871-4e5f-b474-5df9ffb1339a,network=Network(323d6e5c-22ce-42d5-9b73-0e267906ab4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d4efe4-58')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c99fc28-38, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=3c99fc28-3863-4b6d-a7a2-d762e2e86538,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c99fc28-38')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c582588-66, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:80:b9,bridge_name='br-int',has_traffic_filtering=True,id=6c582588-6620-4f3e-b7d9-1a87cdff3120,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c582588-66')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaafdad05-0e, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:cd,bridge_name='br-int',has_traffic_filtering=True,id=aafdad05-0ebd-466e-a2c0-9e41a431847e,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaafdad05-0e')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "358d82a9-c685-43e5-9484-3762fd03d794", "address": "fa:16:3e:f4:9b:64", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358d82a9-c6", "ovs_interfaceid": "358d82a9-c685-43e5-9484-3762fd03d794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap358d82a9-c6, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:64,bridge_name='br-int',has_traffic_filtering=True,id=358d82a9-c685-43e5-9484-3762fd03d794,network=Network(9ce41ab4-039b-4e55-a208-cacb7edd91b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358d82a9-c6')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf96acb-28, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3f:a3,bridge_name='br-int',has_traffic_filtering=True,id=ccf96acb-280b-46df-ab5a-535ed5b54a83,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf96acb-28')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1200243041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1200243041',id=11,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcRIB3aDdvSroCv8Zjk4nwwa7xv/TMK2cEQ1BJvfxqz4oLKZSxv4LUqODlIw0i1V8FmJs/phk7eUuKTvFzAJpaZxSzsWHgIoslawtk+D6dmyOgNKX3PONdN2DQqHXZ5w==',key_name='tempest-keypair-1642270546',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb864281a044721bd9fbf84d80c01b9',ramdisk_id='',reservation_id='r-dpejtr30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1184634350',owner_user_name='tempest-TaggedBootDevicesTest_v242-1184634350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f439bc4e6d14fc9af440d9c86f48d55',uuid=01fe9d2f-11ec-4b10-979b-d1b0896c5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converting VIF {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca101cc4-7c, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:14 user nova-compute[72184]: INFO os_vif [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=ca101cc4-7cea-43c7-ada1-01298a576185,network=Network(30577c62-3e16-466c-84a1-09ec69a449d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca101cc4-7c')
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpVTMCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-13d4efe4-5871-4e5f-b474-5df9ffb1339a for instance with vm_state active and task_state deleting.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-3c99fc28-3863-4b6d-a7a2-d762e2e86538 for instance with vm_state active and task_state deleting.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-358d82a9-c685-43e5-9484-3762fd03d794 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-358d82a9-c685-43e5-9484-3762fd03d794 for instance with vm_state active and task_state deleting.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state building and task_state spawning.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-b9f5303e-e540-4a6d-a19f-c992564382b2 req-66829bd7-eb48-41de-b963-7d4a5dcf505e service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state building and task_state spawning.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[180153e2-5dd7-4f05-9bbd-44fecf9a8679]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a702b18c-cad8-450c-8779-d0236800fa6a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30277d2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f8071-5509-41c7-8c51-f71efffedb97]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b1f39a-4274-46b8-b513-425c4ead4528]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10cbb6f-09b7-4406-8808-ad5859eee484]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a262219b-a7c8-4215-893b-89376378e9bc]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732c7c3-f5e9-4779-b46b-bac08e335ec3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e833f0-af32-4c71-bbf6-a0d1fdf9c358]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260]
Aug 01 16:55:14 user nova-compute[72184]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-6c582588-6620-4f3e-b7d9-1a87cdff3120 for instance with vm_state active and task_state deleting.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-aafdad05-0ebd-466e-a2c0-9e41a431847e for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-aafdad05-0ebd-466e-a2c0-9e41a431847e for instance with vm_state active and task_state deleting.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-unplugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-unplugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING nova.compute.manager [req-9b715af0-1c07-4014-9572-8077e1a43a9b req-78300308-22ac-4fde-91d1-7805ba5cbd6f service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-ccf96acb-280b-46df-ab5a-535ed5b54a83 for instance with vm_state active and task_state deleting.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2a6236-79ce-423d-8e01-027acd743f15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bae425-729b-4af2-af2a-923e75ddb838]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== disconnect_volume: return (323ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiLAwrSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:14 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37fb56b-5550-4c2c-b8e5-4f2559af6c49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: INFO nova.compute.manager [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Detaching volume 060ef087-4e27-4323-84ed-cc8e22c891a3
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e4b2a-f491-497b-8597-9d79edd3d439]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:14 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30182e51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb06d2b-6c5d-4b8f-a9d3-80df6ebba594]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: INFO nova.virt.block_device [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Attempting to driver detach volume 060ef087-4e27-4323-84ed-cc8e22c891a3 from mountpoint /dev/vdb
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10835b45-ddf1-4be3-9d43-75b4bdb63cd6]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e06a6-7c53-47cd-996a-825c9610b6b1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Attempting to detach device vdb from instance 7896ab2a-6313-459a-b5b9-916929f96970 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:55:14 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:55:14 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 16:55:14 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:55:14 user nova-compute[72184]:   <serial>060ef087-4e27-4323-84ed-cc8e22c891a3</serial>
Aug 01 16:55:14 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:55:14 user nova-compute[72184]: </disk>
Aug 01 16:55:14 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Successfully detached device vdb from instance 7896ab2a-6313-459a-b5b9-916929f96970 from the persistent domain config.
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7896ab2a-6313-459a-b5b9-916929f96970 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:55:14 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:55:14 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 16:55:14 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:55:14 user nova-compute[72184]:   <serial>060ef087-4e27-4323-84ed-cc8e22c891a3</serial>
Aug 01 16:55:14 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:55:14 user nova-compute[72184]: </disk>
Aug 01 16:55:14 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[227f1eac-1edc-4f96-834d-b2c093284ad7]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e517c5-5fba-4a0a-90ff-80069fbbee8c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[318fa5c7-1c73-4377-a14f-cb3447a27bcb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260]
Aug 01 16:55:15 user nova-compute[72184]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fc1ced7-e7d1-482c-a958-bd43b92636c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2bf76d-5781-4015-b001-f9c2a44165ec]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== disconnect_volume: return (300ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcHyQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:15 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fa7b57-f19b-492b-a20a-b14a20304c7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaee63e-f186-4300-a743-9049509e85ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301813e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c0d623-8d42-4d99-8ed0-e47eb6afc067]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7fc14-af57-4cb5-8f02-006ccf656f46]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[52489987-7fed-4f29-8b8b-ecd3cdea5203]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c530cc-4014-4e71-8212-bffb78358e37]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-f3ca8887-4569-4a74-b490-8752007189a9 req-a373a383-100f-4a32-94e8-b834c65acf5d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3ca8887-4569-4a74-b490-8752007189a9 req-a373a383-100f-4a32-94e8-b834c65acf5d service nova] Acquiring lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3ca8887-4569-4a74-b490-8752007189a9 req-a373a383-100f-4a32-94e8-b834c65acf5d service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3ca8887-4569-4a74-b490-8752007189a9 req-a373a383-100f-4a32-94e8-b834c65acf5d service nova] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-f3ca8887-4569-4a74-b490-8752007189a9 req-a373a383-100f-4a32-94e8-b834c65acf5d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] No waiting events found dispatching network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:15 user nova-compute[72184]: WARNING nova.compute.manager [req-f3ca8887-4569-4a74-b490-8752007189a9 req-a373a383-100f-4a32-94e8-b834c65acf5d service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received unexpected event network-vif-plugged-ca101cc4-7cea-43c7-ada1-01298a576185 for instance with vm_state active and task_state deleting.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b8188-3325-40d5-bfbf-fdb9834f9a1a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690908915.2949426, 7896ab2a-6313-459a-b5b9-916929f96970 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Successfully detached device vdb from instance 7896ab2a-6313-459a-b5b9-916929f96970 from the live domain config.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdaWGLNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '060ef087-4e27-4323-84ed-cc8e22c891a3'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:15 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c7b29-4bce-4ae2-a7f1-5f074550b51a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260]
Aug 01 16:55:15 user nova-compute[72184]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f44d904-544c-4fa8-ab82-2bb6c66b6a38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce94a7dd-b634-41f6-a1ba-62eb6c548b1d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] <== disconnect_volume: return (301ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Deleting instance files /opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c_del
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Deletion of /opt/stack/data/nova/instances/01fe9d2f-11ec-4b10-979b-d1b0896c5c2c_del complete
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.055s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6caca-e779-412b-8be8-bf03f69983b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a282c-74a3-465a-b5e6-57ae7cfb9263]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:55:15 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301813da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3'): ({'sdg'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Removing single pathed devices sdg {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Took 3.51 seconds to destroy the instance on the hypervisor.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d396795d-dfca-4339-b104-99742f27e1b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1e8d0-536f-472b-af92-b96ecab94903]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Flushing IO for device /dev/sdg {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49da42df-9a8a-46ab-ae99-9af0032bdaaa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fc8838-201e-4be5-8c4a-82ea948eebae]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916ed59-b187-444e-a11f-c4ed10793014]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38412c-eb22-4798-88ed-a7a2d2384ce0]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260]
Aug 01 16:55:15 user nova-compute[72184]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3, portal: 172.16.0.220,3260] successful.
Aug 01 16:55:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060ef087-4e27-4323-84ed-cc8e22c891a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38a9405-670b-4877-8893-d92d739ee8a2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] <== disconnect_volume: return (361ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908915.6717486, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Resumed (Lifecycle Event)
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance spawned successfully.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908915.6752152, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Started (Lifecycle Event)
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:15 user nova-compute[72184]: INFO nova.compute.manager [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Took 21.39 seconds to build instance.
Aug 01 16:55:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-361f6a01-a754-430b-874d-1397746e2895 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.478s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:16 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lazy-loading 'flavor' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0f38d08b-a912-4f7f-a4de-145f7918f6c5 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.888s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-ed8d153f-5dd1-4795-9a4f-3fb98c8ed889 req-12e5471b-a45a-4b69-8f1a-401b846f1396 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-deleted-358d82a9-c685-43e5-9484-3762fd03d794 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:17 user nova-compute[72184]: INFO nova.compute.manager [req-ed8d153f-5dd1-4795-9a4f-3fb98c8ed889 req-12e5471b-a45a-4b69-8f1a-401b846f1396 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Neutron deleted interface 358d82a9-c685-43e5-9484-3762fd03d794; detaching it from the instance and deleting it from the info cache
Aug 01 16:55:17 user nova-compute[72184]: DEBUG nova.network.neutron [req-ed8d153f-5dd1-4795-9a4f-3fb98c8ed889 req-12e5471b-a45a-4b69-8f1a-401b846f1396 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [{"id": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "address": "fa:16:3e:72:d5:dc", "network": {"id": "323d6e5c-22ce-42d5-9b73-0e267906ab4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1859451053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d4efe4-58", "ovs_interfaceid": "13d4efe4-5871-4e5f-b474-5df9ffb1339a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "address": "fa:16:3e:a4:63:ac", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c99fc28-38", "ovs_interfaceid": "3c99fc28-3863-4b6d-a7a2-d762e2e86538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "address": "fa:16:3e:1d:80:b9", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c582588-66", "ovs_interfaceid": "6c582588-6620-4f3e-b7d9-1a87cdff3120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "address": "fa:16:3e:7a:54:cd", "network": {"id": "9ce41ab4-039b-4e55-a208-cacb7edd91b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1435097063", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaafdad05-0e", "ovs_interfaceid": "aafdad05-0ebd-466e-a2c0-9e41a431847e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "address": "fa:16:3e:54:3f:a3", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf96acb-28", "ovs_interfaceid": "ccf96acb-280b-46df-ab5a-535ed5b54a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca101cc4-7cea-43c7-ada1-01298a576185", "address": "fa:16:3e:56:18:a2", "network": {"id": "30577c62-3e16-466c-84a1-09ec69a449d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-626207067", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7bb864281a044721bd9fbf84d80c01b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca101cc4-7c", "ovs_interfaceid": "ca101cc4-7cea-43c7-ada1-01298a576185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-ed8d153f-5dd1-4795-9a4f-3fb98c8ed889 req-12e5471b-a45a-4b69-8f1a-401b846f1396 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Detach interface failed, port_id=358d82a9-c685-43e5-9484-3762fd03d794, reason: Instance 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:55:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:19 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:19 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Took 4.40 seconds to deallocate network for instance.
Aug 01 16:55:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-d623289e-51c4-44f4-8ce5-b8374507c5f9 req-c1db9add-d334-42ee-84f6-0ca6a5e37f76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-deleted-ca101cc4-7cea-43c7-ada1-01298a576185 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-d623289e-51c4-44f4-8ce5-b8374507c5f9 req-c1db9add-d334-42ee-84f6-0ca6a5e37f76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-deleted-ccf96acb-280b-46df-ab5a-535ed5b54a83 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-d623289e-51c4-44f4-8ce5-b8374507c5f9 req-c1db9add-d334-42ee-84f6-0ca6a5e37f76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-deleted-13d4efe4-5871-4e5f-b474-5df9ffb1339a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-d623289e-51c4-44f4-8ce5-b8374507c5f9 req-c1db9add-d334-42ee-84f6-0ca6a5e37f76 service nova] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Received event network-vif-deleted-aafdad05-0ebd-466e-a2c0-9e41a431847e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:21 user nova-compute[72184]: INFO nova.compute.manager [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Took 2.12 seconds to detach 3 volumes for instance.
Aug 01 16:55:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:22 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:55:22 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:55:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:22 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Deleted allocations for instance 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c
Aug 01 16:55:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a18e9b7-f798-4177-a184-e06253708ac7 tempest-TaggedBootDevicesTest_v242-1184634350 tempest-TaggedBootDevicesTest_v242-1184634350-project-member] Lock "01fe9d2f-11ec-4b10-979b-d1b0896c5c2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.701s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "04d3b87c-2cec-499c-9972-b99310f6751f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:24 user nova-compute[72184]: INFO nova.compute.manager [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Terminating instance
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-6faed068-b883-4bf1-9782-1a78cdf3a429 req-56699858-92a4-4406-a72c-708acbb42411 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-vif-unplugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6faed068-b883-4bf1-9782-1a78cdf3a429 req-56699858-92a4-4406-a72c-708acbb42411 service nova] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6faed068-b883-4bf1-9782-1a78cdf3a429 req-56699858-92a4-4406-a72c-708acbb42411 service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6faed068-b883-4bf1-9782-1a78cdf3a429 req-56699858-92a4-4406-a72c-708acbb42411 service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-6faed068-b883-4bf1-9782-1a78cdf3a429 req-56699858-92a4-4406-a72c-708acbb42411 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] No waiting events found dispatching network-vif-unplugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-6faed068-b883-4bf1-9782-1a78cdf3a429 req-56699858-92a4-4406-a72c-708acbb42411 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-vif-unplugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:24 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Instance destroyed successfully.
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.objects.instance [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lazy-loading 'resources' on Instance uuid 04d3b87c-2cec-499c-9972-b99310f6751f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1325419929',display_name='tempest-VolumesActionsTest-instance-1325419929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1325419929',id=12,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20fabda688874990bf8049f9bd5f0464',ramdisk_id='',reservation_id='r-gioibnkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1024961451',owner_user_name='tempest-VolumesActionsTest-1024961451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:53:32Z,user_data=None,user_id='04e472c46a3b420f886e62afc4623893',uuid=04d3b87c-2cec-499c-9972-b99310f6751f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Converting VIF {"id": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "address": "fa:16:3e:f0:c5:20", "network": {"id": "338b37fe-4f8c-49f7-8c2d-54ccff747cd6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-309062035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fabda688874990bf8049f9bd5f0464", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3159d0a-1d", "ovs_interfaceid": "b3159d0a-1dcb-493e-ab62-fdbdb069439b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG os_vif [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3159d0a-1d, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:24 user nova-compute[72184]: INFO os_vif [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:20,bridge_name='br-int',has_traffic_filtering=True,id=b3159d0a-1dcb-493e-ab62-fdbdb069439b,network=Network(338b37fe-4f8c-49f7-8c2d-54ccff747cd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3159d0a-1d')
Aug 01 16:55:24 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Deleting instance files /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f_del
Aug 01 16:55:24 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Deletion of /opt/stack/data/nova/instances/04d3b87c-2cec-499c-9972-b99310f6751f_del complete
Aug 01 16:55:25 user nova-compute[72184]: INFO nova.compute.manager [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 16:55:25 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:55:25 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:55:25 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:55:25 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:25 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Took 0.58 seconds to deallocate network for instance.
Aug 01 16:55:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-7f438ae1-addb-43c9-b93c-63e64466f012 req-bc4cff43-f930-4d5e-b4b5-8ac0d0b93a3a service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-vif-deleted-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:25 user nova-compute[72184]: INFO nova.compute.manager [req-7f438ae1-addb-43c9-b93c-63e64466f012 req-bc4cff43-f930-4d5e-b4b5-8ac0d0b93a3a service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Neutron deleted interface b3159d0a-1dcb-493e-ab62-fdbdb069439b; detaching it from the instance and deleting it from the info cache
Aug 01 16:55:25 user nova-compute[72184]: DEBUG nova.network.neutron [req-7f438ae1-addb-43c9-b93c-63e64466f012 req-bc4cff43-f930-4d5e-b4b5-8ac0d0b93a3a service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-7f438ae1-addb-43c9-b93c-63e64466f012 req-bc4cff43-f930-4d5e-b4b5-8ac0d0b93a3a service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Detach interface failed, port_id=b3159d0a-1dcb-493e-ab62-fdbdb069439b, reason: Instance 04d3b87c-2cec-499c-9972-b99310f6751f could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:55:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:26 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Deleted allocations for instance 04d3b87c-2cec-499c-9972-b99310f6751f
Aug 01 16:55:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5eeb7b6c-3378-45ce-8f21-5805a3bef4d7 tempest-VolumesActionsTest-1024961451 tempest-VolumesActionsTest-1024961451-project-member] Lock "04d3b87c-2cec-499c-9972-b99310f6751f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-a72a99cf-3734-4d9c-8e9f-a0343efd4b32 req-7782a353-d9ac-46ce-aaaf-aa191e560049 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received event network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a72a99cf-3734-4d9c-8e9f-a0343efd4b32 req-7782a353-d9ac-46ce-aaaf-aa191e560049 service nova] Acquiring lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a72a99cf-3734-4d9c-8e9f-a0343efd4b32 req-7782a353-d9ac-46ce-aaaf-aa191e560049 service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a72a99cf-3734-4d9c-8e9f-a0343efd4b32 req-7782a353-d9ac-46ce-aaaf-aa191e560049 service nova] Lock "04d3b87c-2cec-499c-9972-b99310f6751f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-a72a99cf-3734-4d9c-8e9f-a0343efd4b32 req-7782a353-d9ac-46ce-aaaf-aa191e560049 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] No waiting events found dispatching network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:26 user nova-compute[72184]: WARNING nova.compute.manager [req-a72a99cf-3734-4d9c-8e9f-a0343efd4b32 req-7782a353-d9ac-46ce-aaaf-aa191e560049 service nova] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Received unexpected event network-vif-plugged-b3159d0a-1dcb-493e-ab62-fdbdb069439b for instance with vm_state deleted and task_state None.
Aug 01 16:55:29 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908914.0032036, 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:29 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] VM Stopped (Lifecycle Event)
Aug 01 16:55:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0cfacf74-359c-4688-8d96-2869b70d77da None None] [instance: 01fe9d2f-11ec-4b10-979b-d1b0896c5c2c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:31 user nova-compute[72184]: INFO nova.compute.manager [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Terminating instance
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-27fe3dbf-a58a-42f2-ad6d-15f6216bad3c req-38303b21-a73d-4725-8f3a-b85a411bc6c9 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-vif-unplugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-27fe3dbf-a58a-42f2-ad6d-15f6216bad3c req-38303b21-a73d-4725-8f3a-b85a411bc6c9 service nova] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-27fe3dbf-a58a-42f2-ad6d-15f6216bad3c req-38303b21-a73d-4725-8f3a-b85a411bc6c9 service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-27fe3dbf-a58a-42f2-ad6d-15f6216bad3c req-38303b21-a73d-4725-8f3a-b85a411bc6c9 service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-27fe3dbf-a58a-42f2-ad6d-15f6216bad3c req-38303b21-a73d-4725-8f3a-b85a411bc6c9 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] No waiting events found dispatching network-vif-unplugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-27fe3dbf-a58a-42f2-ad6d-15f6216bad3c req-38303b21-a73d-4725-8f3a-b85a411bc6c9 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-vif-unplugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Instance destroyed successfully.
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.objects.instance [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lazy-loading 'resources' on Instance uuid 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-468467211',display_name='tempest-ServersNegativeTestJSON-server-468467211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-468467211',id=13,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3358e9a5875f4d28b190013ad6eed14b',ramdisk_id='',reservation_id='r-xa933t0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2037366998',owner_user_name='tempest-ServersNegativeTestJSON-2037366998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:53:51Z,user_data=None,user_id='d5955b0107544c9cbce9e1c5c305cd3d',uuid=420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converting VIF {"id": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "address": "fa:16:3e:c2:5a:7d", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e5d5ce5-f5", "ovs_interfaceid": "7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG os_vif [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e5d5ce5-f5, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:31 user nova-compute[72184]: INFO os_vif [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e5d5ce5-f5')
Aug 01 16:55:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Deleting instance files /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f_del
Aug 01 16:55:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Deletion of /opt/stack/data/nova/instances/420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f_del complete
Aug 01 16:55:31 user nova-compute[72184]: INFO nova.compute.manager [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 01 16:55:31 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:55:31 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:55:32 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:32 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Took 0.50 seconds to deallocate network for instance.
Aug 01 16:55:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-ef33317f-eb97-4891-9c4b-823ad73effd0 req-9e05bf99-f0b6-4a24-88f1-2a755c4b5173 service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-vif-deleted-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:32 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:55:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:55:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:32 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Deleted allocations for instance 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f
Aug 01 16:55:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-48536c04-f4ec-4045-a634-0d497921915b tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-82af5213-d2be-49fe-bf97-b539deea6147 req-fbdc980f-b251-42d2-a51d-00870547183a service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received event network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-82af5213-d2be-49fe-bf97-b539deea6147 req-fbdc980f-b251-42d2-a51d-00870547183a service nova] Acquiring lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-82af5213-d2be-49fe-bf97-b539deea6147 req-fbdc980f-b251-42d2-a51d-00870547183a service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-82af5213-d2be-49fe-bf97-b539deea6147 req-fbdc980f-b251-42d2-a51d-00870547183a service nova] Lock "420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-82af5213-d2be-49fe-bf97-b539deea6147 req-fbdc980f-b251-42d2-a51d-00870547183a service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] No waiting events found dispatching network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:33 user nova-compute[72184]: WARNING nova.compute.manager [req-82af5213-d2be-49fe-bf97-b539deea6147 req-fbdc980f-b251-42d2-a51d-00870547183a service nova] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Received unexpected event network-vif-plugged-7e5d5ce5-f5c1-412a-b84b-6f4b2d981a78 for instance with vm_state deleted and task_state None.
Aug 01 16:55:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:55:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:55:34 user nova-compute[72184]: INFO nova.compute.claims [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Claim successful on node user
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:55:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.policy [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a36b28188247476b9b2f08c735a9089c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25e02b908e24e88b6ab9e0b86fdc699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:55:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Creating image(s)
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "/opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "/opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk 1073741824" returned: 0 in 0.052s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.162s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Successfully created port: cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Cannot resize image /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'migration_context' on Instance uuid 6b5f0090-73c9-44f2-b989-28a3084daa58 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Ensure instance console log exists: /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Successfully updated port: cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "refresh_cache-6b5f0090-73c9-44f2-b989-28a3084daa58" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquired lock "refresh_cache-6b5f0090-73c9-44f2-b989-28a3084daa58" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-changed-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Refreshing instance network info cache due to event network-changed-cb9adf79-31cf-4d90-b271-f243d6d1558b. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] Acquiring lock "refresh_cache-6b5f0090-73c9-44f2-b989-28a3084daa58" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Updating instance_info_cache with network_info: [{"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Releasing lock "refresh_cache-6b5f0090-73c9-44f2-b989-28a3084daa58" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Instance network_info: |[{"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] Acquired lock "refresh_cache-6b5f0090-73c9-44f2-b989-28a3084daa58" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.network.neutron [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Refreshing network info cache for port cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:55:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Start _get_guest_xml network_info=[{"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:55:37 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:55:37 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-643154892',display_name='tempest-VolumesAdminNegativeTest-server-643154892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-643154892',id=17,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b25e02b908e24e88b6ab9e0b86fdc699',ramdisk_id='',reservation_id='r-jw3lxrc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1181939340',owner_user_name='tempest-VolumesAdminNegativeTest-1181939340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:55:36Z,user_data=None,user_id='a36b28188247476b9b2f08c735a9089c',uuid=6b5f0090-73c9-44f2-b989-28a3084daa58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converting VIF {"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b5f0090-73c9-44f2-b989-28a3084daa58 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:55:38 user nova-compute[72184]:   <uuid>6b5f0090-73c9-44f2-b989-28a3084daa58</uuid>
Aug 01 16:55:38 user nova-compute[72184]:   <name>instance-00000011</name>
Aug 01 16:55:38 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:55:38 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:55:38 user nova-compute[72184]:   <metadata>
Aug 01 16:55:38 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:55:38 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:55:38 user nova-compute[72184]:       <nova:name>tempest-VolumesAdminNegativeTest-server-643154892</nova:name>
Aug 01 16:55:38 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:55:37</nova:creationTime>
Aug 01 16:55:38 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:55:38 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:55:38 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:55:38 user nova-compute[72184]:       <nova:owner>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:user uuid="a36b28188247476b9b2f08c735a9089c">tempest-VolumesAdminNegativeTest-1181939340-project-member</nova:user>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:project uuid="b25e02b908e24e88b6ab9e0b86fdc699">tempest-VolumesAdminNegativeTest-1181939340</nova:project>
Aug 01 16:55:38 user nova-compute[72184]:       </nova:owner>
Aug 01 16:55:38 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:55:38 user nova-compute[72184]:       <nova:ports>
Aug 01 16:55:38 user nova-compute[72184]:         <nova:port uuid="cb9adf79-31cf-4d90-b271-f243d6d1558b">
Aug 01 16:55:38 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 16:55:38 user nova-compute[72184]:         </nova:port>
Aug 01 16:55:38 user nova-compute[72184]:       </nova:ports>
Aug 01 16:55:38 user nova-compute[72184]:     </nova:instance>
Aug 01 16:55:38 user nova-compute[72184]:   </metadata>
Aug 01 16:55:38 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:55:38 user nova-compute[72184]:     <system>
Aug 01 16:55:38 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:55:38 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:55:38 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:55:38 user nova-compute[72184]:       <entry name="serial">6b5f0090-73c9-44f2-b989-28a3084daa58</entry>
Aug 01 16:55:38 user nova-compute[72184]:       <entry name="uuid">6b5f0090-73c9-44f2-b989-28a3084daa58</entry>
Aug 01 16:55:38 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:55:38 user nova-compute[72184]:     </system>
Aug 01 16:55:38 user nova-compute[72184]:   </sysinfo>
Aug 01 16:55:38 user nova-compute[72184]:   <os>
Aug 01 16:55:38 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:55:38 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:55:38 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:55:38 user nova-compute[72184]:   </os>
Aug 01 16:55:38 user nova-compute[72184]:   <features>
Aug 01 16:55:38 user nova-compute[72184]:     <acpi/>
Aug 01 16:55:38 user nova-compute[72184]:     <apic/>
Aug 01 16:55:38 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:55:38 user nova-compute[72184]:   </features>
Aug 01 16:55:38 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:55:38 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:55:38 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:55:38 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:55:38 user nova-compute[72184]:   </clock>
Aug 01 16:55:38 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:55:38 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:55:38 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:55:38 user nova-compute[72184]:   </cpu>
Aug 01 16:55:38 user nova-compute[72184]:   <devices>
Aug 01 16:55:38 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:55:38 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:55:38 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk"/>
Aug 01 16:55:38 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:55:38 user nova-compute[72184]:     </disk>
Aug 01 16:55:38 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:55:38 user nova-compute[72184]:       <mac address="fa:16:3e:ed:a1:c5"/>
Aug 01 16:55:38 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:55:38 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:55:38 user nova-compute[72184]:       <target dev="tapcb9adf79-31"/>
Aug 01 16:55:38 user nova-compute[72184]:     </interface>
Aug 01 16:55:38 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:55:38 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/console.log" append="off"/>
Aug 01 16:55:38 user nova-compute[72184]:     </serial>
Aug 01 16:55:38 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:55:38 user nova-compute[72184]:     <video>
Aug 01 16:55:38 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:55:38 user nova-compute[72184]:     </video>
Aug 01 16:55:38 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:55:38 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:55:38 user nova-compute[72184]:     </rng>
Aug 01 16:55:38 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:55:38 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:55:38 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:55:38 user nova-compute[72184]:     </memballoon>
Aug 01 16:55:38 user nova-compute[72184]:   </devices>
Aug 01 16:55:38 user nova-compute[72184]: </domain>
Aug 01 16:55:38 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-643154892',display_name='tempest-VolumesAdminNegativeTest-server-643154892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-643154892',id=17,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b25e02b908e24e88b6ab9e0b86fdc699',ramdisk_id='',reservation_id='r-jw3lxrc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1181939340',owner_user_name='tempest-VolumesAdminNegativeTest-1181939340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:55:36Z,user_data=None,user_id='a36b28188247476b9b2f08c735a9089c',uuid=6b5f0090-73c9-44f2-b989-28a3084daa58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converting VIF {"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG os_vif [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb9adf79-31, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb9adf79-31, col_values=(('external_ids', {'iface-id': 'cb9adf79-31cf-4d90-b271-f243d6d1558b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a1:c5', 'vm-uuid': '6b5f0090-73c9-44f2-b989-28a3084daa58'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:38 user nova-compute[72184]: INFO os_vif [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31')
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] No VIF found with MAC fa:16:3e:ed:a1:c5, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.network.neutron [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Updated VIF entry in instance network info cache for port cb9adf79-31cf-4d90-b271-f243d6d1558b. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG nova.network.neutron [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Updating instance_info_cache with network_info: [{"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a4e5c5f0-1a22-41ef-bb41-7f07d12fb4d9 req-a6bcaf9f-2951-4906-ae11-d1aadabba319 service nova] Releasing lock "refresh_cache-6b5f0090-73c9-44f2-b989-28a3084daa58" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-8d6953e9-7cf3-48f1-96c5-aa89e2bbc5a6 req-20c90b1b-cd7b-4089-b1f6-cf772980f5c8 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8d6953e9-7cf3-48f1-96c5-aa89e2bbc5a6 req-20c90b1b-cd7b-4089-b1f6-cf772980f5c8 service nova] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8d6953e9-7cf3-48f1-96c5-aa89e2bbc5a6 req-20c90b1b-cd7b-4089-b1f6-cf772980f5c8 service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8d6953e9-7cf3-48f1-96c5-aa89e2bbc5a6 req-20c90b1b-cd7b-4089-b1f6-cf772980f5c8 service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-8d6953e9-7cf3-48f1-96c5-aa89e2bbc5a6 req-20c90b1b-cd7b-4089-b1f6-cf772980f5c8 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] No waiting events found dispatching network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:39 user nova-compute[72184]: WARNING nova.compute.manager [req-8d6953e9-7cf3-48f1-96c5-aa89e2bbc5a6 req-20c90b1b-cd7b-4089-b1f6-cf772980f5c8 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received unexpected event network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b for instance with vm_state building and task_state spawning.
Aug 01 16:55:39 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908924.9165137, 04d3b87c-2cec-499c-9972-b99310f6751f => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:39 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] VM Stopped (Lifecycle Event)
Aug 01 16:55:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-3f9ad810-ff70-40ed-b473-460a2645bb54 None None] [instance: 04d3b87c-2cec-499c-9972-b99310f6751f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908941.4628885, 6b5f0090-73c9-44f2-b989-28a3084daa58 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] VM Resumed (Lifecycle Event)
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Instance spawned successfully.
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908941.4639397, 6b5f0090-73c9-44f2-b989-28a3084daa58 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] VM Started (Lifecycle Event)
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:41 user nova-compute[72184]: INFO nova.compute.manager [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Took 6.71 seconds to build instance.
Aug 01 16:55:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0762fe53-8645-4664-b6aa-8392b2615d05 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.818s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-ebbc67ed-a9d1-4478-9c6f-8fa89ad1ad4a req-5463f0ad-9031-408c-b9ff-b101facab5ef service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ebbc67ed-a9d1-4478-9c6f-8fa89ad1ad4a req-5463f0ad-9031-408c-b9ff-b101facab5ef service nova] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ebbc67ed-a9d1-4478-9c6f-8fa89ad1ad4a req-5463f0ad-9031-408c-b9ff-b101facab5ef service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ebbc67ed-a9d1-4478-9c6f-8fa89ad1ad4a req-5463f0ad-9031-408c-b9ff-b101facab5ef service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-ebbc67ed-a9d1-4478-9c6f-8fa89ad1ad4a req-5463f0ad-9031-408c-b9ff-b101facab5ef service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] No waiting events found dispatching network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:55:41 user nova-compute[72184]: WARNING nova.compute.manager [req-ebbc67ed-a9d1-4478-9c6f-8fa89ad1ad4a req-5463f0ad-9031-408c-b9ff-b101facab5ef service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received unexpected event network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b for instance with vm_state active and task_state None.
Aug 01 16:55:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908931.6269026, 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:55:46 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] VM Stopped (Lifecycle Event)
Aug 01 16:55:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a5886282-7a8a-4dbb-a9be-3cda48b93fee None None] [instance: 420f7478-a3f2-41c8-bfd1-3cb6f5aa5c3f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:55:50 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7119MB free_disk=25.47028350830078GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7b407b54-6887-4b20-a3ae-50a2ce5777be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 70e188c4-72bc-4842-bb3f-a9d611c38164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7896ab2a-6313-459a-b5b9-916929f96970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 9944d144-6f02-4d7b-993d-9d80639dbb76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 6b5f0090-73c9-44f2-b989-28a3084daa58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:55:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:55:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:55:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:55:51 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:55:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:55:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG nova.objects.instance [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'flavor' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:55:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:55:56 user nova-compute[72184]: INFO nova.compute.manager [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Attaching volume 56cde5f3-f122-4535-a57a-2ad98a50093b to /dev/vdb
Aug 01 16:55:57 user nova-compute[72184]: DEBUG os_brick.utils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ebfb8a-e3de-4eb7-ba88-b97da9957882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cc2ae5-d5db-4416-b76e-37e7579ac5c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13027b4-4d82-49f6-9a2d-b8d6925c9ca9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c35ab3-f6dc-40f3-9e01-526149b11636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:55:57 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:55:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5331d487-54b9-4cef-b459-1ef1211f5e4c]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG os_brick.utils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:55:57 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating existing volume attachment record: 12accf16-527c-45cd-9dfa-f29262d3ffa6 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:55:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-changed-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Refreshing instance network info cache due to event network-changed-415b8e1b-0e0d-4209-b151-4474047270e8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] Acquiring lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] Acquired lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Refreshing network info cache for port 415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updated VIF entry in instance network info cache for port 415b8e1b-0e0d-4209-b151-4474047270e8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating instance_info_cache with network_info: [{"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:55:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3a47b786-9c09-424c-ab8f-a6ecabf140be req-99e477e4-59ae-48d8-8981-284f53be1be4 service nova] Releasing lock "refresh_cache-9944d144-6f02-4d7b-993d-9d80639dbb76" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:00 user nova-compute[72184]: INFO nova.compute.manager [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Rebuilding instance
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.compute.manager [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'pci_requests' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'pci_devices' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'resources' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'migration_context' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72184) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-5e63d7c7-0975-4750-864e-e29d23fd7d72 req-0e918e4b-ab17-4673-a495-5a69fcdacc19 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-unplugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5e63d7c7-0975-4750-864e-e29d23fd7d72 req-0e918e4b-ab17-4673-a495-5a69fcdacc19 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5e63d7c7-0975-4750-864e-e29d23fd7d72 req-0e918e4b-ab17-4673-a495-5a69fcdacc19 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5e63d7c7-0975-4750-864e-e29d23fd7d72 req-0e918e4b-ab17-4673-a495-5a69fcdacc19 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-5e63d7c7-0975-4750-864e-e29d23fd7d72 req-0e918e4b-ab17-4673-a495-5a69fcdacc19 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-unplugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:00 user nova-compute[72184]: WARNING nova.compute.manager [req-5e63d7c7-0975-4750-864e-e29d23fd7d72 req-0e918e4b-ab17-4673-a495-5a69fcdacc19 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-unplugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state active and task_state rebuilding.
Aug 01 16:56:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance destroyed successfully.
Aug 01 16:56:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance destroyed successfully.
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-894135068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-939615552',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKERJF4uaqhkevsOU0CTgv4cvmtOfkduxIFnR4IKMKEFoDveR2Y4WHtOig0qbK7Z3yz4nDK8w978Pm6Z3P1G4EQBHH6UmbCg42YzbkboRMW939x/8GEQInnkfQK23WBviQ==',key_name='tempest-keypair-890600544',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-voymav9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=9944d144-6f02-4d7b-993d-9d80639dbb76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap415b8e1b-0e, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:01 user nova-compute[72184]: INFO os_vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e')
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:01 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b67219d-4ea4-4123-955e-66bd964c966d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0957cc8-bfe5-4d77-a859-275e7bdde0f2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:01 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:01 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:01 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:01 user nova-compute[72184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3018449ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'): ({'sdf'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Removing single pathed devices sdf {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f47195-24dc-4f5f-83a6-5bde60143820]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f15c44-8767-49eb-aa42-dbd91d5f5def]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flushing IO for device /dev/sdf {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4b199-b555-4512-b9f7-571c966dfbf7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb0875b-a907-4662-986b-bbf658bdcb45]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] SCSI volumes sdf have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09017eac-949f-4225-aed1-bed5c587c00c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df6f66-092b-4d36-a57f-dcf3c304678b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]
Aug 01 16:56:01 user nova-compute[72184]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.
Aug 01 16:56:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d481178-318b-4d71-a5f2-a9a7baadfb0f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== disconnect_volume: return (301ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:56:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Deleting instance files /opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76_del
Aug 01 16:56:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Deletion of /opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76_del complete
Aug 01 16:56:01 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9944d144-6f02-4d7b-993d-9d80639dbb76 could not be found.
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:01 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88301abb-2a2f-47bb-8f83-16cdbf6b61fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e2776-8ede-4065-8b85-b4fe37b6c74e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:01 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:01 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff87df640>, {}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Disconnecting from: [] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== disconnect_volume: return (62ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f020aa0-bf1b-4b7f-be09-648954c19932 req-dcf2a9f7-7ba6-48e6-9c7d-c3faaa777f59 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f020aa0-bf1b-4b7f-be09-648954c19932 req-dcf2a9f7-7ba6-48e6-9c7d-c3faaa777f59 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f020aa0-bf1b-4b7f-be09-648954c19932 req-dcf2a9f7-7ba6-48e6-9c7d-c3faaa777f59 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f020aa0-bf1b-4b7f-be09-648954c19932 req-dcf2a9f7-7ba6-48e6-9c7d-c3faaa777f59 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f020aa0-bf1b-4b7f-be09-648954c19932 req-dcf2a9f7-7ba6-48e6-9c7d-c3faaa777f59 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:02 user nova-compute[72184]: WARNING nova.compute.manager [req-0f020aa0-bf1b-4b7f-be09-648954c19932 req-dcf2a9f7-7ba6-48e6-9c7d-c3faaa777f59 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state active and task_state rebuilding.
Aug 01 16:56:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Preparing to wait for external event volume-reimaged-e024d764-d153-4abd-9082-22daa0510480 {{(pid=72184) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:05 user nova-compute[72184]: INFO nova.compute.manager [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Terminating instance
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzBfdMYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:05 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f0007-adac-486a-9e8e-e164c1c25f3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:56:05 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[181eed54-de1b-4956-9abb-a90b1afd8225]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b] added
Aug 01 16:56:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed6cd01-237e-485d-890a-94e717678acc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfce04c-c053-4d8c-a5e2-19dab36a7424]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzBfdMYN {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzBfdMYN" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b814f-abff-45ef-b40c-0e5a35a3b3c3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wzBfdMYN'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac46efb-abac-4b15-8a66-3411e7949fa0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d483b0-aa39-4e91-814a-20ea24815bf9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:05 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:05 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:56:05 user nova-compute[72184]: INFO nova.compute.claims [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Claim successful on node user
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[527724a7-86ec-4444-aee9-a166e373abb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260]
Aug 01 16:56:05 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260] successful.
Aug 01 16:56:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a39a7e-4b9f-41ff-826b-89980f7b3546]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2481e576-8014-4538-83af-3ecd40d10ee2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:05 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:05 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:05 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:05 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65d61f-d102-4e6d-8a8d-4f66b86d487b]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzBfdMYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-0baed805-943b-4a7c-bc1d-b6bfad9750c5 req-a900ffc3-99ac-4575-9ba2-5a030cff2b4c service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-vif-unplugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0baed805-943b-4a7c-bc1d-b6bfad9750c5 req-a900ffc3-99ac-4575-9ba2-5a030cff2b4c service nova] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0baed805-943b-4a7c-bc1d-b6bfad9750c5 req-a900ffc3-99ac-4575-9ba2-5a030cff2b4c service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0baed805-943b-4a7c-bc1d-b6bfad9750c5 req-a900ffc3-99ac-4575-9ba2-5a030cff2b4c service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-0baed805-943b-4a7c-bc1d-b6bfad9750c5 req-a900ffc3-99ac-4575-9ba2-5a030cff2b4c service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] No waiting events found dispatching network-vif-unplugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-0baed805-943b-4a7c-bc1d-b6bfad9750c5 req-a900ffc3-99ac-4575-9ba2-5a030cff2b4c service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-vif-unplugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:56:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Instance destroyed successfully.
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lazy-loading 'resources' on Instance uuid 7896ab2a-6313-459a-b5b9-916929f96970 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1875124576',display_name='tempest-TestVolumeSwap-server-1875124576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1875124576',id=10,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITshTlth8Bg5Q5jF4LZ2fPOyV7MrdS7MyvzA4Kb0gmDcCWACK00n3205/N0JOX8XaDmHyhp1BOBTUxb+YCiQUuo24Vhc1bkZrUEhO+WeEakNZxqHng4+3n9biOiJbz54Q==',key_name='tempest-keypair-1833002847',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99be24c2573f410e81daf0409829fdb7',ramdisk_id='',reservation_id='r-x8apcg0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1156395630',owner_user_name='tempest-TestVolumeSwap-1156395630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='630b2eb8d9dd459d818f2ea96163609c',uuid=7896ab2a-6313-459a-b5b9-916929f96970,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Converting VIF {"id": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "address": "fa:16:3e:79:43:32", "network": {"id": "705a87f6-7502-4433-ab62-5eefe7fcc493", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2143841228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99be24c2573f410e81daf0409829fdb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5142ef5e-16", "ovs_interfaceid": "5142ef5e-1637-4384-ac99-cd294cbeceb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG os_vif [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5142ef5e-16, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:56:06 user nova-compute[72184]: INFO os_vif [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:43:32,bridge_name='br-int',has_traffic_filtering=True,id=5142ef5e-1637-4384-ac99-cd294cbeceb0,network=Network(705a87f6-7502-4433-ab62-5eefe7fcc493),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5142ef5e-16')
Aug 01 16:56:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Deleting instance files /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970_del
Aug 01 16:56:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Deletion of /opt/stack/data/nova/instances/7896ab2a-6313-459a-b5b9-916929f96970_del complete
Aug 01 16:56:06 user nova-compute[72184]: INFO nova.compute.manager [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:56:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.policy [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fb14a139a3d49adb000837495669841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df99c9ee2284aee92507254f44b1d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:56:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Creating image(s)
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23364626637366364', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364626637366364', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.objects.instance [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'flavor' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:56:06 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:56:06 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 16:56:06 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:56:06 user nova-compute[72184]:   <serial>56cde5f3-f122-4535-a57a-2ad98a50093b</serial>
Aug 01 16:56:06 user nova-compute[72184]: </disk>
Aug 01 16:56:06 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.164s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk 1073741824" returned: 0 in 0.128s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:07 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Took 1.01 seconds to deallocate network for instance.
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Cannot resize image /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'migration_context' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Ensure instance console log exists: /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No VIF found with MAC fa:16:3e:bc:88:b2, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Successfully created port: 4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aa5e6370-e572-444f-882f-8d971e08128a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.551s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:07 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Deleted allocations for instance 7896ab2a-6313-459a-b5b9-916929f96970
Aug 01 16:56:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f963a6ed-f33d-46e9-8ee4-e74d11840ac2 tempest-TestVolumeSwap-1156395630 tempest-TestVolumeSwap-1156395630-project-member] Lock "7896ab2a-6313-459a-b5b9-916929f96970" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.789s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] Acquiring lock "7896ab2a-6313-459a-b5b9-916929f96970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] Lock "7896ab2a-6313-459a-b5b9-916929f96970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] No waiting events found dispatching network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:08 user nova-compute[72184]: WARNING nova.compute.manager [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received unexpected event network-vif-plugged-5142ef5e-1637-4384-ac99-cd294cbeceb0 for instance with vm_state deleted and task_state None.
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-3d7cbbcc-bc72-4ffb-8923-ad2b89837eed req-42f48595-0f8b-493c-9e64-6f2dce57e1b2 service nova] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Received event network-vif-deleted-5142ef5e-1637-4384-ac99-cd294cbeceb0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:08 user nova-compute[72184]: INFO nova.compute.manager [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Rescuing
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Successfully updated port: 4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquired lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-changed-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Refreshing instance network info cache due to event network-changed-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] Acquiring lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Releasing lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Instance network_info: |[{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] Acquired lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Refreshing network info cache for port 4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Start _get_guest_xml network_info=[{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:56:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.objects.instance [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'pci_devices' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:56:09 user nova-compute[72184]:   <uuid>11dbc561-2543-456f-a729-16fc2fc42127</uuid>
Aug 01 16:56:09 user nova-compute[72184]:   <name>instance-00000012</name>
Aug 01 16:56:09 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:56:09 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:56:09 user nova-compute[72184]:   <metadata>
Aug 01 16:56:09 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:56:09 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:56:09 user nova-compute[72184]:       <nova:name>tempest-device-tagging-server-538405060</nova:name>
Aug 01 16:56:09 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:56:09</nova:creationTime>
Aug 01 16:56:09 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:56:09 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:56:09 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:56:09 user nova-compute[72184]:       <nova:owner>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:user uuid="9fb14a139a3d49adb000837495669841">tempest-TaggedAttachmentsTest-759872684-project-member</nova:user>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:project uuid="7df99c9ee2284aee92507254f44b1d72">tempest-TaggedAttachmentsTest-759872684</nova:project>
Aug 01 16:56:09 user nova-compute[72184]:       </nova:owner>
Aug 01 16:56:09 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:56:09 user nova-compute[72184]:       <nova:ports>
Aug 01 16:56:09 user nova-compute[72184]:         <nova:port uuid="4ed9cdf5-62d0-4df7-a7ce-f185da297f8d">
Aug 01 16:56:09 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:56:09 user nova-compute[72184]:         </nova:port>
Aug 01 16:56:09 user nova-compute[72184]:       </nova:ports>
Aug 01 16:56:09 user nova-compute[72184]:     </nova:instance>
Aug 01 16:56:09 user nova-compute[72184]:   </metadata>
Aug 01 16:56:09 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:56:09 user nova-compute[72184]:     <system>
Aug 01 16:56:09 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:56:09 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:56:09 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:56:09 user nova-compute[72184]:       <entry name="serial">11dbc561-2543-456f-a729-16fc2fc42127</entry>
Aug 01 16:56:09 user nova-compute[72184]:       <entry name="uuid">11dbc561-2543-456f-a729-16fc2fc42127</entry>
Aug 01 16:56:09 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:56:09 user nova-compute[72184]:     </system>
Aug 01 16:56:09 user nova-compute[72184]:   </sysinfo>
Aug 01 16:56:09 user nova-compute[72184]:   <os>
Aug 01 16:56:09 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:56:09 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:56:09 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:56:09 user nova-compute[72184]:   </os>
Aug 01 16:56:09 user nova-compute[72184]:   <features>
Aug 01 16:56:09 user nova-compute[72184]:     <acpi/>
Aug 01 16:56:09 user nova-compute[72184]:     <apic/>
Aug 01 16:56:09 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:56:09 user nova-compute[72184]:   </features>
Aug 01 16:56:09 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:56:09 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:56:09 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:56:09 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:56:09 user nova-compute[72184]:   </clock>
Aug 01 16:56:09 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:56:09 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:56:09 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:56:09 user nova-compute[72184]:   </cpu>
Aug 01 16:56:09 user nova-compute[72184]:   <devices>
Aug 01 16:56:09 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:09 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:09 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk"/>
Aug 01 16:56:09 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:56:09 user nova-compute[72184]:     </disk>
Aug 01 16:56:09 user nova-compute[72184]:     <disk type="file" device="cdrom">
Aug 01 16:56:09 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 16:56:09 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.config"/>
Aug 01 16:56:09 user nova-compute[72184]:       <target dev="hda" bus="ide"/>
Aug 01 16:56:09 user nova-compute[72184]:     </disk>
Aug 01 16:56:09 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:56:09 user nova-compute[72184]:       <mac address="fa:16:3e:58:35:96"/>
Aug 01 16:56:09 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:09 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:56:09 user nova-compute[72184]:       <target dev="tap4ed9cdf5-62"/>
Aug 01 16:56:09 user nova-compute[72184]:     </interface>
Aug 01 16:56:09 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:56:09 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/console.log" append="off"/>
Aug 01 16:56:09 user nova-compute[72184]:     </serial>
Aug 01 16:56:09 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:56:09 user nova-compute[72184]:     <video>
Aug 01 16:56:09 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:09 user nova-compute[72184]:     </video>
Aug 01 16:56:09 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:56:09 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:56:09 user nova-compute[72184]:     </rng>
Aug 01 16:56:09 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:56:09 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:56:09 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:56:09 user nova-compute[72184]:     </memballoon>
Aug 01 16:56:09 user nova-compute[72184]:   </devices>
Aug 01 16:56:09 user nova-compute[72184]: </domain>
Aug 01 16:56:09 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG os_vif [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed9cdf5-62, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ed9cdf5-62, col_values=(('external_ids', {'iface-id': '4ed9cdf5-62d0-4df7-a7ce-f185da297f8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:35:96', 'vm-uuid': '11dbc561-2543-456f-a729-16fc2fc42127'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: INFO os_vif [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62')
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No BDM found with device name hda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No VIF found with MAC fa:16:3e:58:35:96, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Using config drive
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-218e231f-611f-449f-8ddf-365d260369f0 req-4ffbf341-82dd-4e91-ab75-13496a83ce1a service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-218e231f-611f-449f-8ddf-365d260369f0 req-4ffbf341-82dd-4e91-ab75-13496a83ce1a service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-218e231f-611f-449f-8ddf-365d260369f0 req-4ffbf341-82dd-4e91-ab75-13496a83ce1a service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-218e231f-611f-449f-8ddf-365d260369f0 req-4ffbf341-82dd-4e91-ab75-13496a83ce1a service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-218e231f-611f-449f-8ddf-365d260369f0 req-4ffbf341-82dd-4e91-ab75-13496a83ce1a service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:09 user nova-compute[72184]: WARNING nova.compute.manager [req-218e231f-611f-449f-8ddf-365d260369f0 req-4ffbf341-82dd-4e91-ab75-13496a83ce1a service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Creating config drive at /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.config
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc8ypdnkl {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc8ypdnkl" returned: 0 in 0.068s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:09 user nova-compute[72184]: INFO nova.compute.manager [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Terminating instance
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updated VIF entry in instance network info cache for port 4ed9cdf5-62d0-4df7-a7ce-f185da297f8d. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d666a114-3a82-4904-810e-34edcba91267 req-8b633f61-281b-42cb-aef1-9d75771f3187 service nova] Releasing lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-changed-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Refreshing instance network info cache due to event network-changed-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] Acquiring lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] Acquired lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Refreshing network info cache for port efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:56:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance destroyed successfully.
Aug 01 16:56:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Attempting a stable device rescue
Aug 01 16:56:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 16:56:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Creating image(s)
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'trusted_certs' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "9b4677bf5b0516060ccd9b2fa610027d27c44e5c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "9b4677bf5b0516060ccd9b2fa610027d27c44e5c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:11 user nova-compute[72184]: WARNING nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-unplugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-unplugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-unplugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:11 user nova-compute[72184]: WARNING nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received unexpected event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with vm_state active and task_state deleting.
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:11 user nova-compute[72184]: WARNING nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received unexpected event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with vm_state active and task_state deleting.
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:11 user nova-compute[72184]: WARNING nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received unexpected event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with vm_state active and task_state deleting.
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-unplugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-unplugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-c766e449-d2e8-474b-bb5c-d9e897a1eef8 req-405e3d6d-f191-4147-8679-1242409b6917 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-unplugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Instance destroyed successfully.
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'resources' on Instance uuid 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2073617209',display_name='tempest-AttachVolumeNegativeTest-server-2073617209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2073617209',id=15,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIrM/dMD2srrNBXHvHI/RLapeuSotCc8AFLiOoMODsR2ZvNR0hzlC3YZXdHchOw8sLU8d87QVyQhKrogSC98EDmweBqBurlkf+MjAo41bvWq1JO3TM+3EjZ1zjT5hcPqw==',key_name='tempest-keypair-2016280627',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-8bdpzxfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:11 user nova-compute[72184]: DEBUG os_vif [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefd03dca-e0, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:12 user nova-compute[72184]: INFO os_vif [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c1:38,bridge_name='br-int',has_traffic_filtering=True,id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd03dca-e0')
Aug 01 16:56:12 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Deleting instance files /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a_del
Aug 01 16:56:12 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Deletion of /opt/stack/data/nova/instances/0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a_del complete
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.part --force-share --output=json" returned: 0 in 0.214s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG nova.virt.images [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] 954baeb9-b298-4d33-83d4-4251a8c3b86e was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.part /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updated VIF entry in instance network info cache for port efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updating instance_info_cache with network_info: [{"id": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "address": "fa:16:3e:2e:c1:38", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd03dca-e0", "ovs_interfaceid": "efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:12 user nova-compute[72184]: INFO nova.compute.manager [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Took 2.43 seconds to destroy the instance on the hypervisor.
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7793f30-4f79-4e26-8cf2-a785f2c80eb2 req-18794f70-3bc1-41a5-98ab-92f751d5c8a8 service nova] Releasing lock "refresh_cache-0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.part /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.converted" returned: 0 in 0.538s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "9b4677bf5b0516060ccd9b2fa610027d27c44e5c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.397s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "9b4677bf5b0516060ccd9b2fa610027d27c44e5c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "9b4677bf5b0516060ccd9b2fa610027d27c44e5c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c,backing_fmt=raw /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c,backing_fmt=raw /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue" returned: 0 in 0.052s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "9b4677bf5b0516060ccd9b2fa610027d27c44e5c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'migration_context' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Start _get_guest_xml network_info=[{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "vif_mac": "fa:16:3e:bc:88:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '954baeb9-b298-4d33-83d4-4251a8c3b86e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '12accf16-527c-45cd-9dfa-f29262d3ffa6', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzBfdMYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a70ead3f-68f7-4be2-acbd-b5b4f6501a54', 'attached_at': '', 'detached_at': '', 'volume_id': '56cde5f3-f122-4535-a57a-2ad98a50093b', 'serial': '56cde5f3-f122-4535-a57a-2ad98a50093b'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'resources' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'numa_topology' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:13 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:13 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'vcpu_model' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzBfdMYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:13 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:13 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:13 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896d9c7-b2ce-4d9f-bbe3-faf453ba6e80]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wzBfdMYN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 16:56:13 user nova-compute[72184]: node.name = iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b
Aug 01 16:56:13 user nova-compute[72184]: node.tpgt = -1
Aug 01 16:56:13 user nova-compute[72184]: node.startup = automatic
Aug 01 16:56:13 user nova-compute[72184]: node.leading_login = No
Aug 01 16:56:13 user nova-compute[72184]: iface.iscsi_ifacename = default
Aug 01 16:56:13 user nova-compute[72184]: iface.net_ifacename = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.ipaddress = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.prefix_len = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.hwaddress = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.transport_name = tcp
Aug 01 16:56:13 user nova-compute[72184]: iface.initiatorname = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.vlan_id = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.vlan_priority = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.vlan_state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.iface_num = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.mtu = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.port = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.bootproto = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.subnet_mask = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.gateway = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_alt_client_id = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_dns = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_learn_iqn = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_vendor_id_state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_vendor_id = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.dhcp_slp_da = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.fragmentation = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.gratuitous_arp = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.incoming_forwarding = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.tos_state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.tos = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.ttl = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.delayed_ack = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.tcp_nagle = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.tcp_wsf_state = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.tcp_wsf = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.tcp_timer_scale = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.tcp_timestamp = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.redirect = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.def_task_mgmt_timeout = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.header_digest = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.data_digest = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.immediate_data = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.initial_r2t = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.data_seq_inorder = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.data_pdu_inorder = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.erl = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.max_receive_data_len = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.first_burst_len = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.max_outstanding_r2t = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.max_burst_len = 0
Aug 01 16:56:13 user nova-compute[72184]: iface.chap_auth = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.bidi_chap = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.strict_login_compliance = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.discovery_auth = <empty>
Aug 01 16:56:13 user nova-compute[72184]: iface.discovery_logout = <empty>
Aug 01 16:56:13 user nova-compute[72184]: node.discovery_address = <empty>
Aug 01 16:56:13 user nova-compute[72184]: node.discovery_port = 0
Aug 01 16:56:13 user nova-compute[72184]: node.discovery_type = static
Aug 01 16:56:13 user nova-compute[72184]: node.session.initial_cmdsn = 0
Aug 01 16:56:13 user nova-compute[72184]: node.session.initial_login_retry_max = 8
Aug 01 16:56:13 user nova-compute[72184]: node.session.xmit_thread_priority = -20
Aug 01 16:56:13 user nova-compute[72184]: node.session.cmds_max = 128
Aug 01 16:56:13 user nova-compute[72184]: node.session.queue_depth = 32
Aug 01 16:56:13 user nova-compute[72184]: node.session.nr_sessions = 1
Aug 01 16:56:13 user nova-compute[72184]: node.session.auth.authmethod = CHAP
Aug 01 16:56:13 user nova-compute[72184]: node.session.auth.username = wzBfdMYN
Aug 01 16:56:13 user nova-compute[72184]: node.session.auth.password = ***
Aug 01 16:56:13 user nova-compute[72184]: node.session.auth.username_in = <empty>
Aug 01 16:56:13 user nova-compute[72184]: node.session.auth.password_in = <empty>
Aug 01 16:56:13 user nova-compute[72184]: node.session.auth.chap_algs = MD5
Aug 01 16:56:13 user nova-compute[72184]: node.session.timeo.replacement_timeout = 120
Aug 01 16:56:13 user nova-compute[72184]: node.session.err_timeo.abort_timeout = 15
Aug 01 16:56:13 user nova-compute[72184]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 16:56:13 user nova-compute[72184]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 16:56:13 user nova-compute[72184]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.FastAbort = Yes
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.InitialR2T = No
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.ImmediateData = Yes
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.MaxConnections = 1
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 16:56:13 user nova-compute[72184]: node.session.iscsi.ERL = 0
Aug 01 16:56:13 user nova-compute[72184]: node.session.scan = manual
Aug 01 16:56:13 user nova-compute[72184]: node.session.reopen_max = 0
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].address = 172.16.0.220
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].port = 3260
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].startup = manual
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].tcp.window_size = 524288
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].tcp.type_of_service = 0
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].timeo.logout_timeout = 15
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].timeo.login_timeout = 15
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].timeo.auth_timeout = 45
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].iscsi.DataDigest = None
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].iscsi.IFMarker = No
Aug 01 16:56:13 user nova-compute[72184]: node.conn[0].iscsi.OFMarker = No
Aug 01 16:56:13 user nova-compute[72184]: # END RECORD
Aug 01 16:56:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1843f1-006a-4c46-b6a7-137251cb3404]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[323c59b6-7d10-4acc-8397-51e490583a69]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzBfdMYN {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzBfdMYN" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907b36d-1ba6-43a8-a698-7863e8fcaf41]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wzBfdMYN'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:13 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Took 1.13 seconds to deallocate network for instance.
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-1ef65c52-1763-4e7e-aa3a-1711197b0653 req-75a4ef11-0c51-4f04-9693-abdf1c8f5822 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-deleted-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:13 user nova-compute[72184]: INFO nova.compute.manager [req-1ef65c52-1763-4e7e-aa3a-1711197b0653 req-75a4ef11-0c51-4f04-9693-abdf1c8f5822 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Neutron deleted interface efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea; detaching it from the instance and deleting it from the info cache
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.network.neutron [req-1ef65c52-1763-4e7e-aa3a-1711197b0653 req-75a4ef11-0c51-4f04-9693-abdf1c8f5822 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-1ef65c52-1763-4e7e-aa3a-1711197b0653 req-75a4ef11-0c51-4f04-9693-abdf1c8f5822 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Detach interface failed, port_id=efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea, reason: Instance 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45cd1e9-b44d-4221-b138-82629332d7d8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82130984-cabc-4d04-9510-c98f464a0a04]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:13 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:13 user nova-compute[72184]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:13 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:13 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:13 user nova-compute[72184]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:13 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.174s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6eac68-261f-425a-b1b6-4ab6d7891407]: (4, ('0 0 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzBfdMYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] <== connect_volume: return (205ms) {'type': 'block', 'scsi_wwn': '23364626637366364', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364626637366364', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-842643259',display_name='tempest-ServerStableDeviceRescueTest-server-842643259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-842643259',id=7,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIohFOUjcgbCcEJVHNMMVKdtDg/iJ7UD6loeqFDRoqcofm/E/mwfo4ZcHkSNKUtSw7ZiWLoK7zIV1QA46aomYsQO7Yf5OX1J9BUKLKSkNxkKQyisbBwt6FItJj+GMp58Cg==',key_name='tempest-keypair-1152278047',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba59b45c64bc4f50babadda186b3c8ac',ramdisk_id='',reservation_id='r-vrl7515u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-245198057',owner_user_name='tempest-ServerStableDeviceRescueTest-245198057-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fde93855aff4cd7b32bca4e3a56380e',uuid=a70ead3f-68f7-4be2-acbd-b5b4f6501a54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "vif_mac": "fa:16:3e:bc:88:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converting VIF {"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "vif_mac": "fa:16:3e:bc:88:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'pci_devices' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:56:13 user nova-compute[72184]:   <uuid>a70ead3f-68f7-4be2-acbd-b5b4f6501a54</uuid>
Aug 01 16:56:13 user nova-compute[72184]:   <name>instance-00000007</name>
Aug 01 16:56:13 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:56:13 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:56:13 user nova-compute[72184]:   <metadata>
Aug 01 16:56:13 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:56:13 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:56:13 user nova-compute[72184]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-842643259</nova:name>
Aug 01 16:56:13 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:56:13</nova:creationTime>
Aug 01 16:56:13 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:56:13 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:56:13 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:56:13 user nova-compute[72184]:       <nova:owner>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:user uuid="2fde93855aff4cd7b32bca4e3a56380e">tempest-ServerStableDeviceRescueTest-245198057-project-member</nova:user>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:project uuid="ba59b45c64bc4f50babadda186b3c8ac">tempest-ServerStableDeviceRescueTest-245198057</nova:project>
Aug 01 16:56:13 user nova-compute[72184]:       </nova:owner>
Aug 01 16:56:13 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:56:13 user nova-compute[72184]:       <nova:ports>
Aug 01 16:56:13 user nova-compute[72184]:         <nova:port uuid="2d8ec797-0e9e-4016-983f-aca7420380b2">
Aug 01 16:56:13 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 16:56:13 user nova-compute[72184]:         </nova:port>
Aug 01 16:56:13 user nova-compute[72184]:       </nova:ports>
Aug 01 16:56:13 user nova-compute[72184]:     </nova:instance>
Aug 01 16:56:13 user nova-compute[72184]:   </metadata>
Aug 01 16:56:13 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:56:13 user nova-compute[72184]:     <system>
Aug 01 16:56:13 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:56:13 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:56:13 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:56:13 user nova-compute[72184]:       <entry name="serial">a70ead3f-68f7-4be2-acbd-b5b4f6501a54</entry>
Aug 01 16:56:13 user nova-compute[72184]:       <entry name="uuid">a70ead3f-68f7-4be2-acbd-b5b4f6501a54</entry>
Aug 01 16:56:13 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:56:13 user nova-compute[72184]:     </system>
Aug 01 16:56:13 user nova-compute[72184]:   </sysinfo>
Aug 01 16:56:13 user nova-compute[72184]:   <os>
Aug 01 16:56:13 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:56:13 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:56:13 user nova-compute[72184]:   </os>
Aug 01 16:56:13 user nova-compute[72184]:   <features>
Aug 01 16:56:13 user nova-compute[72184]:     <acpi/>
Aug 01 16:56:13 user nova-compute[72184]:     <apic/>
Aug 01 16:56:13 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:56:13 user nova-compute[72184]:   </features>
Aug 01 16:56:13 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:56:13 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:56:13 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:56:13 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:56:13 user nova-compute[72184]:   </clock>
Aug 01 16:56:13 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:56:13 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:56:13 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:56:13 user nova-compute[72184]:   </cpu>
Aug 01 16:56:13 user nova-compute[72184]:   <devices>
Aug 01 16:56:13 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:13 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:13 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk"/>
Aug 01 16:56:13 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:56:13 user nova-compute[72184]:     </disk>
Aug 01 16:56:13 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:56:13 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:56:13 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 16:56:13 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 16:56:13 user nova-compute[72184]:       <serial>56cde5f3-f122-4535-a57a-2ad98a50093b</serial>
Aug 01 16:56:13 user nova-compute[72184]:     </disk>
Aug 01 16:56:13 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:13 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:13 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue"/>
Aug 01 16:56:13 user nova-compute[72184]:       <target dev="vdc" bus="virtio"/>
Aug 01 16:56:13 user nova-compute[72184]:       <boot order="1"/>
Aug 01 16:56:13 user nova-compute[72184]:     </disk>
Aug 01 16:56:13 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:56:13 user nova-compute[72184]:       <mac address="fa:16:3e:bc:88:b2"/>
Aug 01 16:56:13 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:13 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:56:13 user nova-compute[72184]:       <target dev="tap2d8ec797-0e"/>
Aug 01 16:56:13 user nova-compute[72184]:     </interface>
Aug 01 16:56:13 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:56:13 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/console.log" append="off"/>
Aug 01 16:56:13 user nova-compute[72184]:     </serial>
Aug 01 16:56:13 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:56:13 user nova-compute[72184]:     <video>
Aug 01 16:56:13 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:13 user nova-compute[72184]:     </video>
Aug 01 16:56:13 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:56:13 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:56:13 user nova-compute[72184]:     </rng>
Aug 01 16:56:13 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:56:13 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:56:13 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:56:13 user nova-compute[72184]:     </memballoon>
Aug 01 16:56:13 user nova-compute[72184]:   </devices>
Aug 01 16:56:13 user nova-compute[72184]: </domain>
Aug 01 16:56:13 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:56:13 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance destroyed successfully.
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] No VIF found with MAC fa:16:3e:bc:88:b2, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:13 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Deleted allocations for instance 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Acquiring lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] No waiting events found dispatching network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:13 user nova-compute[72184]: WARNING nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Received unexpected event network-vif-plugged-efd03dca-e0b2-4c5f-b6d3-dad7c515c6ea for instance with vm_state deleted and task_state None.
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:13 user nova-compute[72184]: WARNING nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d for instance with vm_state building and task_state spawning.
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:13 user nova-compute[72184]: WARNING nova.compute.manager [req-5303304a-d48d-4305-a632-3649b7a7d7a1 req-a9d8f691-63f1-45e8-951a-be95b1f05222 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d for instance with vm_state building and task_state spawning.
Aug 01 16:56:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bd337515-360e-4634-8c4e-44e3c4631718 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.330s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908974.4515266, 11dbc561-2543-456f-a729-16fc2fc42127 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] VM Resumed (Lifecycle Event)
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Instance spawned successfully.
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908974.454896, 11dbc561-2543-456f-a729-16fc2fc42127 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] VM Started (Lifecycle Event)
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Took 8.12 seconds to spawn the instance on the hypervisor.
Aug 01 16:56:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:14 user nova-compute[72184]: INFO nova.compute.manager [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Took 9.19 seconds to build instance.
Aug 01 16:56:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bda37672-68fc-496d-a11c-c731a030e362 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.328s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:15 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908960.9932463, 9944d144-6f02-4d7b-993d-9d80639dbb76 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:15 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] VM Stopped (Lifecycle Event)
Aug 01 16:56:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c4529ef9-0a0d-4122-8afd-e52dddf6c1ba None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:16 user nova-compute[72184]: WARNING nova.compute.manager [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:16 user nova-compute[72184]: WARNING nova.compute.manager [req-6da1b2cc-7a0b-4a61-a43f-7276255c428e req-f95a15cb-6a01-4142-baa6-df4cee93b5a0 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for a70ead3f-68f7-4be2-acbd-b5b4f6501a54 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908977.514855, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Resumed (Lifecycle Event)
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-37628bc4-b432-443b-bd06-2266a9ef859a tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908977.5172489, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Started (Lifecycle Event)
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc req-ed519f0c-ffde-49a0-b404-262e83f1c611 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event volume-reimaged-e024d764-d153-4abd-9082-22daa0510480 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc req-ed519f0c-ffde-49a0-b404-262e83f1c611 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc req-ed519f0c-ffde-49a0-b404-262e83f1c611 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc req-ed519f0c-ffde-49a0-b404-262e83f1c611 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc req-ed519f0c-ffde-49a0-b404-262e83f1c611 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Processing event volume-reimaged-e024d764-d153-4abd-9082-22daa0510480 {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:56:20 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908965.9441385, 7896ab2a-6313-459a-b5b9-916929f96970 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:20 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] VM Stopped (Lifecycle Event)
Aug 01 16:56:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-24f78303-d276-41d9-b418-e1e68142a7ca None None] [instance: 7896ab2a-6313-459a-b5b9-916929f96970] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:20 user nova-compute[72184]: INFO nova.virt.block_device [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Booting with volume e024d764-d153-4abd-9082-22daa0510480 at /dev/vda
Aug 01 16:56:21 user nova-compute[72184]: DEBUG os_brick.utils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67481641-0155-4cbb-9401-319defe5c6ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca21d9fe-6c63-46ff-8798-1ffa6c783777]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c587670-beeb-423a-a831-8b642067eb53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ee440-4ac6-44f1-a7ec-a93379598007]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:56:21 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:56:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f7e69-927b-489b-a4e6-a6be63bca2cc]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG os_brick.utils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:21 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating existing volume attachment record: 2e64960a-ff3e-4589-a726-8f675b6716c0 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:56:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:26 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690908971.0308955, 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:26 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] VM Stopped (Lifecycle Event)
Aug 01 16:56:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-14dbea51-f8cb-4648-b953-16fea60c8565 None None] [instance: 0253a25a-d4c7-488c-b8c8-f32c3d8f3a6a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:56:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Creating image(s)
Aug 01 16:56:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:56:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Ensure instance console log exists: /opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:56:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Start _get_guest_xml network_info=[{"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '2e64960a-ff3e-4589-a726-8f675b6716c0', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9944d144-6f02-4d7b-993d-9d80639dbb76', 'attached_at': '', 'detached_at': '', 'volume_id': 'e024d764-d153-4abd-9082-22daa0510480', 'serial': 'e024d764-d153-4abd-9082-22daa0510480'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:56:29 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 16:56:29 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:30 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:30 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:30 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7d1150-7690-4f07-a057-bebdaf06673d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:56:30 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd85d6-8169-4291-b9d2-d230dd468634]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480] added
Aug 01 16:56:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea0e867-cc34-4d80-90f2-d81eba18e2fc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7effc93-0c93-431a-9d96-09c5faa08dc5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNQucFjw {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNQucFjw" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16998c18-bdef-4bf8-90eb-8a285a845b00]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNQucFjw'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b4e59-92b3-43dc-bcb4-0fc7566c4d69]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ea6c42-3e9c-457a-9f34-e399171689ca]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d96bc-652a-4017-9d89-559454f0c9bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]
Aug 01 16:56:30 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.
Aug 01 16:56:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8d1426-3ec0-410d-99b7-ff32257a1ec3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af37fc9-0a6e-4572-bfb9-35684c70c900]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:30 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:30 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e887e-4900-4bd4-b1b8-19fa115b132d]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:56:30 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26562333032646264', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562333032646264', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-894135068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-939615552',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKERJF4uaqhkevsOU0CTgv4cvmtOfkduxIFnR4IKMKEFoDveR2Y4WHtOig0qbK7Z3yz4nDK8w978Pm6Z3P1G4EQBHH6UmbCg42YzbkboRMW939x/8GEQInnkfQK23WBviQ==',key_name='tempest-keypair-890600544',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-voymav9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=9944d144-6f02-4d7b-993d-9d80639dbb76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:56:31 user nova-compute[72184]:   <uuid>9944d144-6f02-4d7b-993d-9d80639dbb76</uuid>
Aug 01 16:56:31 user nova-compute[72184]:   <name>instance-0000000e</name>
Aug 01 16:56:31 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:56:31 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:56:31 user nova-compute[72184]:   <metadata>
Aug 01 16:56:31 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:56:31 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:56:31 user nova-compute[72184]:       <nova:name>tempest-ServerActionsV293TestJSON-server-894135068</nova:name>
Aug 01 16:56:31 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:56:29</nova:creationTime>
Aug 01 16:56:31 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:56:31 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:56:31 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:56:31 user nova-compute[72184]:       <nova:owner>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:user uuid="fe5c17c4d0a84d27ad28486da91673bd">tempest-ServerActionsV293TestJSON-637338544-project-member</nova:user>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:project uuid="0ac23356679f461282fce02ad71f2442">tempest-ServerActionsV293TestJSON-637338544</nova:project>
Aug 01 16:56:31 user nova-compute[72184]:       </nova:owner>
Aug 01 16:56:31 user nova-compute[72184]:       <nova:ports>
Aug 01 16:56:31 user nova-compute[72184]:         <nova:port uuid="415b8e1b-0e0d-4209-b151-4474047270e8">
Aug 01 16:56:31 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 16:56:31 user nova-compute[72184]:         </nova:port>
Aug 01 16:56:31 user nova-compute[72184]:       </nova:ports>
Aug 01 16:56:31 user nova-compute[72184]:     </nova:instance>
Aug 01 16:56:31 user nova-compute[72184]:   </metadata>
Aug 01 16:56:31 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:56:31 user nova-compute[72184]:     <system>
Aug 01 16:56:31 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:56:31 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:56:31 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:56:31 user nova-compute[72184]:       <entry name="serial">9944d144-6f02-4d7b-993d-9d80639dbb76</entry>
Aug 01 16:56:31 user nova-compute[72184]:       <entry name="uuid">9944d144-6f02-4d7b-993d-9d80639dbb76</entry>
Aug 01 16:56:31 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:56:31 user nova-compute[72184]:     </system>
Aug 01 16:56:31 user nova-compute[72184]:   </sysinfo>
Aug 01 16:56:31 user nova-compute[72184]:   <os>
Aug 01 16:56:31 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:56:31 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:56:31 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:56:31 user nova-compute[72184]:   </os>
Aug 01 16:56:31 user nova-compute[72184]:   <features>
Aug 01 16:56:31 user nova-compute[72184]:     <acpi/>
Aug 01 16:56:31 user nova-compute[72184]:     <apic/>
Aug 01 16:56:31 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:56:31 user nova-compute[72184]:   </features>
Aug 01 16:56:31 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:56:31 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:56:31 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:56:31 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:56:31 user nova-compute[72184]:   </clock>
Aug 01 16:56:31 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:56:31 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:56:31 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:56:31 user nova-compute[72184]:   </cpu>
Aug 01 16:56:31 user nova-compute[72184]:   <devices>
Aug 01 16:56:31 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:56:31 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:56:31 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 16:56:31 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:56:31 user nova-compute[72184]:       <serial>e024d764-d153-4abd-9082-22daa0510480</serial>
Aug 01 16:56:31 user nova-compute[72184]:     </disk>
Aug 01 16:56:31 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:56:31 user nova-compute[72184]:       <mac address="fa:16:3e:b3:c4:6a"/>
Aug 01 16:56:31 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:31 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:56:31 user nova-compute[72184]:       <target dev="tap415b8e1b-0e"/>
Aug 01 16:56:31 user nova-compute[72184]:     </interface>
Aug 01 16:56:31 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:56:31 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76/console.log" append="off"/>
Aug 01 16:56:31 user nova-compute[72184]:     </serial>
Aug 01 16:56:31 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:56:31 user nova-compute[72184]:     <video>
Aug 01 16:56:31 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:31 user nova-compute[72184]:     </video>
Aug 01 16:56:31 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:56:31 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:56:31 user nova-compute[72184]:     </rng>
Aug 01 16:56:31 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:56:31 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:56:31 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:56:31 user nova-compute[72184]:     </memballoon>
Aug 01 16:56:31 user nova-compute[72184]:   </devices>
Aug 01 16:56:31 user nova-compute[72184]: </domain>
Aug 01 16:56:31 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-894135068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-939615552',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKERJF4uaqhkevsOU0CTgv4cvmtOfkduxIFnR4IKMKEFoDveR2Y4WHtOig0qbK7Z3yz4nDK8w978Pm6Z3P1G4EQBHH6UmbCg42YzbkboRMW939x/8GEQInnkfQK23WBviQ==',key_name='tempest-keypair-890600544',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-voymav9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=9944d144-6f02-4d7b-993d-9d80639dbb76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG os_vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap415b8e1b-0e, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap415b8e1b-0e, col_values=(('external_ids', {'iface-id': '415b8e1b-0e0d-4209-b151-4474047270e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:c4:6a', 'vm-uuid': '9944d144-6f02-4d7b-993d-9d80639dbb76'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:31 user nova-compute[72184]: INFO os_vif [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e')
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] No VIF found with MAC fa:16:3e:b3:c4:6a, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-b2711f99-b190-4c78-9d42-729865f037be req-ef7a9f81-a3ff-48a1-b837-a383dc40bcab service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b2711f99-b190-4c78-9d42-729865f037be req-ef7a9f81-a3ff-48a1-b837-a383dc40bcab service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b2711f99-b190-4c78-9d42-729865f037be req-ef7a9f81-a3ff-48a1-b837-a383dc40bcab service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b2711f99-b190-4c78-9d42-729865f037be req-ef7a9f81-a3ff-48a1-b837-a383dc40bcab service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-b2711f99-b190-4c78-9d42-729865f037be req-ef7a9f81-a3ff-48a1-b837-a383dc40bcab service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:33 user nova-compute[72184]: WARNING nova.compute.manager [req-b2711f99-b190-4c78-9d42-729865f037be req-ef7a9f81-a3ff-48a1-b837-a383dc40bcab service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 16:56:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908995.307782, 9944d144-6f02-4d7b-993d-9d80639dbb76 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] VM Resumed (Lifecycle Event)
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:56:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance spawned successfully.
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-033d4b81-fe4b-46ba-922a-fb5e1bdae403 req-9f04b527-a63f-4af8-9122-700ef3f19801 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-033d4b81-fe4b-46ba-922a-fb5e1bdae403 req-9f04b527-a63f-4af8-9122-700ef3f19801 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-033d4b81-fe4b-46ba-922a-fb5e1bdae403 req-9f04b527-a63f-4af8-9122-700ef3f19801 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-033d4b81-fe4b-46ba-922a-fb5e1bdae403 req-9f04b527-a63f-4af8-9122-700ef3f19801 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-033d4b81-fe4b-46ba-922a-fb5e1bdae403 req-9f04b527-a63f-4af8-9122-700ef3f19801 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:35 user nova-compute[72184]: WARNING nova.compute.manager [req-033d4b81-fe4b-46ba-922a-fb5e1bdae403 req-9f04b527-a63f-4af8-9122-700ef3f19801 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:56:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690908995.3088176, 9944d144-6f02-4d7b-993d-9d80639dbb76 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] VM Started (Lifecycle Event)
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:35 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72184) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 16:56:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-fddc91b2-0513-4ae6-a268-3a89c1ae18fc tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.106s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:37 user nova-compute[72184]: INFO nova.compute.manager [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Rescuing
Aug 01 16:56:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:56:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-55d4b620-a98e-404a-91dc-95f0ba94746b req-2737a59c-60de-40a1-93de-8084be8d08cd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-55d4b620-a98e-404a-91dc-95f0ba94746b req-2737a59c-60de-40a1-93de-8084be8d08cd service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-55d4b620-a98e-404a-91dc-95f0ba94746b req-2737a59c-60de-40a1-93de-8084be8d08cd service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-55d4b620-a98e-404a-91dc-95f0ba94746b req-2737a59c-60de-40a1-93de-8084be8d08cd service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-55d4b620-a98e-404a-91dc-95f0ba94746b req-2737a59c-60de-40a1-93de-8084be8d08cd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:38 user nova-compute[72184]: WARNING nova.compute.manager [req-55d4b620-a98e-404a-91dc-95f0ba94746b req-2737a59c-60de-40a1-93de-8084be8d08cd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state active and task_state rescuing.
Aug 01 16:56:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance destroyed successfully.
Aug 01 16:56:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Attempting rescue
Aug 01 16:56:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 16:56:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Creating image(s)
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG nova.objects.instance [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue" returned: 0 in 0.069s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'migration_context' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Start _get_guest_xml network_info=[{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:da:95:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'resources' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'numa_topology' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:39 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:39 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1697013999',display_name='tempest-ServerRescueNegativeTestJSON-server-1697013999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1697013999',id=2,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-p32h0ws3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:52:13Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=75c3c16a-8768-4b24-8469-35b77664a71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:da:95:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:da:95:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'pci_devices' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:56:39 user nova-compute[72184]:   <uuid>75c3c16a-8768-4b24-8469-35b77664a71e</uuid>
Aug 01 16:56:39 user nova-compute[72184]:   <name>instance-00000002</name>
Aug 01 16:56:39 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:56:39 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:56:39 user nova-compute[72184]:   <metadata>
Aug 01 16:56:39 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:56:39 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:56:39 user nova-compute[72184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1697013999</nova:name>
Aug 01 16:56:39 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:56:39</nova:creationTime>
Aug 01 16:56:39 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:56:39 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:56:39 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:56:39 user nova-compute[72184]:       <nova:owner>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:user uuid="b0e33dc89b5744c2ad3c0d86f759c9c3">tempest-ServerRescueNegativeTestJSON-353659352-project-member</nova:user>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:project uuid="e0a62e50ced845abbadbe12339265fdc">tempest-ServerRescueNegativeTestJSON-353659352</nova:project>
Aug 01 16:56:39 user nova-compute[72184]:       </nova:owner>
Aug 01 16:56:39 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:56:39 user nova-compute[72184]:       <nova:ports>
Aug 01 16:56:39 user nova-compute[72184]:         <nova:port uuid="cc34cd3a-a1e6-4473-9679-b45d861b80ac">
Aug 01 16:56:39 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 16:56:39 user nova-compute[72184]:         </nova:port>
Aug 01 16:56:39 user nova-compute[72184]:       </nova:ports>
Aug 01 16:56:39 user nova-compute[72184]:     </nova:instance>
Aug 01 16:56:39 user nova-compute[72184]:   </metadata>
Aug 01 16:56:39 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:56:39 user nova-compute[72184]:     <system>
Aug 01 16:56:39 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:56:39 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:56:39 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:56:39 user nova-compute[72184]:       <entry name="serial">75c3c16a-8768-4b24-8469-35b77664a71e</entry>
Aug 01 16:56:39 user nova-compute[72184]:       <entry name="uuid">75c3c16a-8768-4b24-8469-35b77664a71e</entry>
Aug 01 16:56:39 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:56:39 user nova-compute[72184]:     </system>
Aug 01 16:56:39 user nova-compute[72184]:   </sysinfo>
Aug 01 16:56:39 user nova-compute[72184]:   <os>
Aug 01 16:56:39 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:56:39 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:56:39 user nova-compute[72184]:   </os>
Aug 01 16:56:39 user nova-compute[72184]:   <features>
Aug 01 16:56:39 user nova-compute[72184]:     <acpi/>
Aug 01 16:56:39 user nova-compute[72184]:     <apic/>
Aug 01 16:56:39 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:56:39 user nova-compute[72184]:   </features>
Aug 01 16:56:39 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:56:39 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:56:39 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:56:39 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:56:39 user nova-compute[72184]:   </clock>
Aug 01 16:56:39 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:56:39 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:56:39 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:56:39 user nova-compute[72184]:   </cpu>
Aug 01 16:56:39 user nova-compute[72184]:   <devices>
Aug 01 16:56:39 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:39 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:39 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue"/>
Aug 01 16:56:39 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:56:39 user nova-compute[72184]:     </disk>
Aug 01 16:56:39 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:39 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:39 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk"/>
Aug 01 16:56:39 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 16:56:39 user nova-compute[72184]:     </disk>
Aug 01 16:56:39 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:56:39 user nova-compute[72184]:       <mac address="fa:16:3e:da:95:ed"/>
Aug 01 16:56:39 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:39 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:56:39 user nova-compute[72184]:       <target dev="tapcc34cd3a-a1"/>
Aug 01 16:56:39 user nova-compute[72184]:     </interface>
Aug 01 16:56:39 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:56:39 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/console.log" append="off"/>
Aug 01 16:56:39 user nova-compute[72184]:     </serial>
Aug 01 16:56:39 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:56:39 user nova-compute[72184]:     <video>
Aug 01 16:56:39 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:39 user nova-compute[72184]:     </video>
Aug 01 16:56:39 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:56:39 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:56:39 user nova-compute[72184]:     </rng>
Aug 01 16:56:39 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:56:39 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:56:39 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:56:39 user nova-compute[72184]:     </memballoon>
Aug 01 16:56:39 user nova-compute[72184]:   </devices>
Aug 01 16:56:39 user nova-compute[72184]: </domain>
Aug 01 16:56:39 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:56:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance destroyed successfully.
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:da:95:ed, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-9930a6a3-de93-4b78-9f4e-36eb7d99f348 req-59ed83ed-40af-4820-aa8c-601a54bae3c5 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9930a6a3-de93-4b78-9f4e-36eb7d99f348 req-59ed83ed-40af-4820-aa8c-601a54bae3c5 service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9930a6a3-de93-4b78-9f4e-36eb7d99f348 req-59ed83ed-40af-4820-aa8c-601a54bae3c5 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9930a6a3-de93-4b78-9f4e-36eb7d99f348 req-59ed83ed-40af-4820-aa8c-601a54bae3c5 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-9930a6a3-de93-4b78-9f4e-36eb7d99f348 req-59ed83ed-40af-4820-aa8c-601a54bae3c5 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:40 user nova-compute[72184]: WARNING nova.compute.manager [req-9930a6a3-de93-4b78-9f4e-36eb7d99f348 req-59ed83ed-40af-4820-aa8c-601a54bae3c5 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state active and task_state rescuing.
Aug 01 16:56:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:42 user nova-compute[72184]: WARNING nova.compute.manager [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state active and task_state rescuing.
Aug 01 16:56:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:42 user nova-compute[72184]: WARNING nova.compute.manager [req-63773c72-4065-4a97-8368-f0dece25634e req-f969db27-3322-4126-a861-cec261971b9b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state active and task_state rescuing.
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 75c3c16a-8768-4b24-8469-35b77664a71e due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909003.1567788, 75c3c16a-8768-4b24-8469-35b77664a71e => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:43 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Resumed (Lifecycle Event)
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-35a7315f-783e-457f-8462-7b4161c7f7d6 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:43 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909003.1577923, 75c3c16a-8768-4b24-8469-35b77664a71e => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:43 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Started (Lifecycle Event)
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:45 user nova-compute[72184]: INFO nova.compute.manager [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Rescuing
Aug 01 16:56:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:56:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG nova.network.neutron [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-a1b50c5a-a463-4ee6-8600-ffab38aec101 req-05756a6a-7eb5-45a9-af0b-51226fba4af1 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a1b50c5a-a463-4ee6-8600-ffab38aec101 req-05756a6a-7eb5-45a9-af0b-51226fba4af1 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a1b50c5a-a463-4ee6-8600-ffab38aec101 req-05756a6a-7eb5-45a9-af0b-51226fba4af1 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a1b50c5a-a463-4ee6-8600-ffab38aec101 req-05756a6a-7eb5-45a9-af0b-51226fba4af1 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-a1b50c5a-a463-4ee6-8600-ffab38aec101 req-05756a6a-7eb5-45a9-af0b-51226fba4af1 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:46 user nova-compute[72184]: WARNING nova.compute.manager [req-a1b50c5a-a463-4ee6-8600-ffab38aec101 req-05756a6a-7eb5-45a9-af0b-51226fba4af1 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance destroyed successfully.
Aug 01 16:56:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Attempting a stable device rescue
Aug 01 16:56:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 16:56:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Creating image(s)
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "/opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG nova.objects.instance [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "fe7003574a5125ebd46068bf550c969fd003c907" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "fe7003574a5125ebd46068bf550c969fd003c907" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.990s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG nova.virt.images [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] 58815dee-d8ea-4798-a4ce-6c0d8f90288c was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.part /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.part /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.converted" returned: 0 in 0.191s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "fe7003574a5125ebd46068bf550c969fd003c907" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.525s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "fe7003574a5125ebd46068bf550c969fd003c907" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "fe7003574a5125ebd46068bf550c969fd003c907" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-b4313b95-db09-4ee0-b066-6b0faa4a0823 req-5bc79f6b-4cd4-4e7e-835a-57385702c924 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b4313b95-db09-4ee0-b066-6b0faa4a0823 req-5bc79f6b-4cd4-4e7e-835a-57385702c924 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b4313b95-db09-4ee0-b066-6b0faa4a0823 req-5bc79f6b-4cd4-4e7e-835a-57385702c924 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b4313b95-db09-4ee0-b066-6b0faa4a0823 req-5bc79f6b-4cd4-4e7e-835a-57385702c924 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-b4313b95-db09-4ee0-b066-6b0faa4a0823 req-5bc79f6b-4cd4-4e7e-835a-57385702c924 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:48 user nova-compute[72184]: WARNING nova.compute.manager [req-b4313b95-db09-4ee0-b066-6b0faa4a0823 req-5bc79f6b-4cd4-4e7e-835a-57385702c924 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907 --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907,backing_fmt=raw /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907,backing_fmt=raw /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue" returned: 0 in 0.057s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "fe7003574a5125ebd46068bf550c969fd003c907" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'migration_context' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Start _get_guest_xml network_info=[{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "vif_mac": "fa:16:3e:2a:08:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '58815dee-d8ea-4798-a4ce-6c0d8f90288c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '98119b81-8843-4e04-98e3-492f2764dcf9', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '69c7aebb-9797-4347-8f0c-ce5c175629e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a22608d4-9439-4d52-b66b-f5d9150027dc', 'serial': 'a22608d4-9439-4d52-b66b-f5d9150027dc'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'resources' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'numa_topology' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:49 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:49 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:56:49 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:49 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:56:49 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3746380-233c-4520-b852-a9bc2a199f9f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TJAsRMwf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 16:56:49 user nova-compute[72184]: node.name = iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc
Aug 01 16:56:49 user nova-compute[72184]: node.tpgt = -1
Aug 01 16:56:49 user nova-compute[72184]: node.startup = automatic
Aug 01 16:56:49 user nova-compute[72184]: node.leading_login = No
Aug 01 16:56:49 user nova-compute[72184]: iface.iscsi_ifacename = default
Aug 01 16:56:49 user nova-compute[72184]: iface.net_ifacename = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.ipaddress = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.prefix_len = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.hwaddress = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.transport_name = tcp
Aug 01 16:56:49 user nova-compute[72184]: iface.initiatorname = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.vlan_id = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.vlan_priority = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.vlan_state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.iface_num = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.mtu = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.port = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.bootproto = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.subnet_mask = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.gateway = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_alt_client_id = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_dns = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_learn_iqn = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_vendor_id_state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_vendor_id = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.dhcp_slp_da = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.fragmentation = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.gratuitous_arp = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.incoming_forwarding = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.tos_state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.tos = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.ttl = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.delayed_ack = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.tcp_nagle = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.tcp_wsf_state = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.tcp_wsf = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.tcp_timer_scale = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.tcp_timestamp = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.redirect = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.def_task_mgmt_timeout = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.header_digest = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.data_digest = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.immediate_data = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.initial_r2t = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.data_seq_inorder = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.data_pdu_inorder = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.erl = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.max_receive_data_len = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.first_burst_len = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.max_outstanding_r2t = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.max_burst_len = 0
Aug 01 16:56:49 user nova-compute[72184]: iface.chap_auth = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.bidi_chap = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.strict_login_compliance = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.discovery_auth = <empty>
Aug 01 16:56:49 user nova-compute[72184]: iface.discovery_logout = <empty>
Aug 01 16:56:49 user nova-compute[72184]: node.discovery_address = <empty>
Aug 01 16:56:49 user nova-compute[72184]: node.discovery_port = 0
Aug 01 16:56:49 user nova-compute[72184]: node.discovery_type = static
Aug 01 16:56:49 user nova-compute[72184]: node.session.initial_cmdsn = 0
Aug 01 16:56:49 user nova-compute[72184]: node.session.initial_login_retry_max = 8
Aug 01 16:56:49 user nova-compute[72184]: node.session.xmit_thread_priority = -20
Aug 01 16:56:49 user nova-compute[72184]: node.session.cmds_max = 128
Aug 01 16:56:49 user nova-compute[72184]: node.session.queue_depth = 32
Aug 01 16:56:49 user nova-compute[72184]: node.session.nr_sessions = 1
Aug 01 16:56:49 user nova-compute[72184]: node.session.auth.authmethod = CHAP
Aug 01 16:56:49 user nova-compute[72184]: node.session.auth.username = TJAsRMwf
Aug 01 16:56:49 user nova-compute[72184]: node.session.auth.password = ***
Aug 01 16:56:49 user nova-compute[72184]: node.session.auth.username_in = <empty>
Aug 01 16:56:49 user nova-compute[72184]: node.session.auth.password_in = <empty>
Aug 01 16:56:49 user nova-compute[72184]: node.session.auth.chap_algs = MD5
Aug 01 16:56:49 user nova-compute[72184]: node.session.timeo.replacement_timeout = 120
Aug 01 16:56:49 user nova-compute[72184]: node.session.err_timeo.abort_timeout = 15
Aug 01 16:56:49 user nova-compute[72184]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 16:56:49 user nova-compute[72184]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 16:56:49 user nova-compute[72184]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.FastAbort = Yes
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.InitialR2T = No
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.ImmediateData = Yes
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.MaxConnections = 1
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 16:56:49 user nova-compute[72184]: node.session.iscsi.ERL = 0
Aug 01 16:56:49 user nova-compute[72184]: node.session.scan = manual
Aug 01 16:56:49 user nova-compute[72184]: node.session.reopen_max = 0
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].address = 172.16.0.220
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].port = 3260
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].startup = manual
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].tcp.window_size = 524288
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].tcp.type_of_service = 0
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].timeo.logout_timeout = 15
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].timeo.login_timeout = 15
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].timeo.auth_timeout = 45
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].iscsi.DataDigest = None
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].iscsi.IFMarker = No
Aug 01 16:56:49 user nova-compute[72184]: node.conn[0].iscsi.OFMarker = No
Aug 01 16:56:49 user nova-compute[72184]: # END RECORD
Aug 01 16:56:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235f95f-17fe-4bfd-be3a-961079c7c662]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.063s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7c2d8e-a437-411a-ad2a-b969f3a3e788]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJAsRMwf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJAsRMwf" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5f5ba-8c66-4040-9453-c8a3324f798e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TJAsRMwf'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[350b114e-6dea-4802-a823-783104231545]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5edd05-4305-4f96-9531-e6dbe104aab3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:49 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:49 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:49 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:56:49 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:56:49 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:56:49 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:56:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] HCTL ('40', '0', '0', 0) found on session 12 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8461c3e6-a9bb-4394-9d5c-ac3df262aec5]: (4, ('0 0 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching for a device in session 12 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.329s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== connect_volume: return (331ms) {'type': 'block', 'scsi_wwn': '26230323930643239', 'path': '/dev/sdi'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230323930643239', 'path': '/dev/sdi'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-18467087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-18467087',id=16,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:55:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-kbqzxqu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:55:16Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=69c7aebb-9797-4347-8f0c-ce5c175629e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "vif_mac": "fa:16:3e:2a:08:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "vif_mac": "fa:16:3e:2a:08:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'pci_devices' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:56:49 user nova-compute[72184]:   <uuid>69c7aebb-9797-4347-8f0c-ce5c175629e2</uuid>
Aug 01 16:56:49 user nova-compute[72184]:   <name>instance-00000010</name>
Aug 01 16:56:49 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:56:49 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:56:49 user nova-compute[72184]:   <metadata>
Aug 01 16:56:49 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:56:49 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:56:49 user nova-compute[72184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-18467087</nova:name>
Aug 01 16:56:49 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:56:49</nova:creationTime>
Aug 01 16:56:49 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:56:49 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:56:49 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:56:49 user nova-compute[72184]:       <nova:owner>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:user uuid="1b9ae86640754099bb01c48a6807075f">tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member</nova:user>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:project uuid="b13772bce6fa482189f819cb065170b3">tempest-ServerBootFromVolumeStableRescueTest-388641611</nova:project>
Aug 01 16:56:49 user nova-compute[72184]:       </nova:owner>
Aug 01 16:56:49 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:56:49 user nova-compute[72184]:       <nova:ports>
Aug 01 16:56:49 user nova-compute[72184]:         <nova:port uuid="0bb757b6-8cb4-4a5b-986f-3299f6cc5265">
Aug 01 16:56:49 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 16:56:49 user nova-compute[72184]:         </nova:port>
Aug 01 16:56:49 user nova-compute[72184]:       </nova:ports>
Aug 01 16:56:49 user nova-compute[72184]:     </nova:instance>
Aug 01 16:56:49 user nova-compute[72184]:   </metadata>
Aug 01 16:56:49 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:56:49 user nova-compute[72184]:     <system>
Aug 01 16:56:49 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:56:49 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:56:49 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:56:49 user nova-compute[72184]:       <entry name="serial">69c7aebb-9797-4347-8f0c-ce5c175629e2</entry>
Aug 01 16:56:49 user nova-compute[72184]:       <entry name="uuid">69c7aebb-9797-4347-8f0c-ce5c175629e2</entry>
Aug 01 16:56:49 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:56:49 user nova-compute[72184]:     </system>
Aug 01 16:56:49 user nova-compute[72184]:   </sysinfo>
Aug 01 16:56:49 user nova-compute[72184]:   <os>
Aug 01 16:56:49 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:56:49 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:56:49 user nova-compute[72184]:   </os>
Aug 01 16:56:49 user nova-compute[72184]:   <features>
Aug 01 16:56:49 user nova-compute[72184]:     <acpi/>
Aug 01 16:56:49 user nova-compute[72184]:     <apic/>
Aug 01 16:56:49 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:56:49 user nova-compute[72184]:   </features>
Aug 01 16:56:49 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:56:49 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:56:49 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:56:49 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:56:49 user nova-compute[72184]:   </clock>
Aug 01 16:56:49 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:56:49 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:56:49 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:56:49 user nova-compute[72184]:   </cpu>
Aug 01 16:56:49 user nova-compute[72184]:   <devices>
Aug 01 16:56:49 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 16:56:49 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:56:49 user nova-compute[72184]:       <source dev="/dev/sdi"/>
Aug 01 16:56:49 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:56:49 user nova-compute[72184]:       <serial>a22608d4-9439-4d52-b66b-f5d9150027dc</serial>
Aug 01 16:56:49 user nova-compute[72184]:     </disk>
Aug 01 16:56:49 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:49 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:49 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue"/>
Aug 01 16:56:49 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 16:56:49 user nova-compute[72184]:       <boot order="1"/>
Aug 01 16:56:49 user nova-compute[72184]:     </disk>
Aug 01 16:56:49 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:56:49 user nova-compute[72184]:       <mac address="fa:16:3e:2a:08:cd"/>
Aug 01 16:56:49 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:49 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:56:49 user nova-compute[72184]:       <target dev="tap0bb757b6-8c"/>
Aug 01 16:56:49 user nova-compute[72184]:     </interface>
Aug 01 16:56:49 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:56:49 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/console.log" append="off"/>
Aug 01 16:56:49 user nova-compute[72184]:     </serial>
Aug 01 16:56:49 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:56:49 user nova-compute[72184]:     <video>
Aug 01 16:56:49 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:49 user nova-compute[72184]:     </video>
Aug 01 16:56:49 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:56:49 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:56:49 user nova-compute[72184]:     </rng>
Aug 01 16:56:49 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:56:49 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:56:49 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:56:49 user nova-compute[72184]:     </memballoon>
Aug 01 16:56:49 user nova-compute[72184]:   </devices>
Aug 01 16:56:49 user nova-compute[72184]: </domain>
Aug 01 16:56:49 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:56:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance destroyed successfully.
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No VIF found with MAC fa:16:3e:2a:08:cd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-b462d9b8-a291-4abf-a2ea-285f21e2df37 req-1e4b30ae-d8ec-479b-8772-46d602eddda7 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b462d9b8-a291-4abf-a2ea-285f21e2df37 req-1e4b30ae-d8ec-479b-8772-46d602eddda7 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b462d9b8-a291-4abf-a2ea-285f21e2df37 req-1e4b30ae-d8ec-479b-8772-46d602eddda7 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b462d9b8-a291-4abf-a2ea-285f21e2df37 req-1e4b30ae-d8ec-479b-8772-46d602eddda7 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-b462d9b8-a291-4abf-a2ea-285f21e2df37 req-1e4b30ae-d8ec-479b-8772-46d602eddda7 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:51 user nova-compute[72184]: WARNING nova.compute.manager [req-b462d9b8-a291-4abf-a2ea-285f21e2df37 req-1e4b30ae-d8ec-479b-8772-46d602eddda7 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2bdcde4b-215d-446b-864f-1527f8b952d9 req-2bb74165-4723-4aa2-b208-56587448cdeb service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2bdcde4b-215d-446b-864f-1527f8b952d9 req-2bb74165-4723-4aa2-b208-56587448cdeb service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2bdcde4b-215d-446b-864f-1527f8b952d9 req-2bb74165-4723-4aa2-b208-56587448cdeb service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2bdcde4b-215d-446b-864f-1527f8b952d9 req-2bb74165-4723-4aa2-b208-56587448cdeb service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2bdcde4b-215d-446b-864f-1527f8b952d9 req-2bb74165-4723-4aa2-b208-56587448cdeb service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:56:54 user nova-compute[72184]: WARNING nova.compute.manager [req-2bdcde4b-215d-446b-864f-1527f8b952d9 req-2bb74165-4723-4aa2-b208-56587448cdeb service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state active and task_state rescuing.
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 69c7aebb-9797-4347-8f0c-ce5c175629e2 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909013.6422453, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Resumed (Lifecycle Event)
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-02e94243-f34d-425b-8950-12bfc3aa6020 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:54 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:54 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7192MB free_disk=25.350399017333984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909013.6434987, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:56:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Started (Lifecycle Event)
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7b407b54-6887-4b20-a3ae-50a2ce5777be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 70e188c4-72bc-4842-bb3f-a9d611c38164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 9944d144-6f02-4d7b-993d-9d80639dbb76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 6b5f0090-73c9-44f2-b989-28a3084daa58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 11dbc561-2543-456f-a729-16fc2fc42127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.599s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:54 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:56:54 user nova-compute[72184]: INFO nova.compute.claims [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Claim successful on node user
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:56:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.policy [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cb37dea792d4fc98ac32d9c282020d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955f909d63034bc8ace106364f8d9b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:56:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Creating image(s)
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk 1073741824" returned: 0 in 0.066s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Cannot resize image /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'migration_context' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Ensure instance console log exists: /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Successfully created port: fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updating instance_info_cache with network_info: [{"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-7b407b54-6887-4b20-a3ae-50a2ce5777be" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Successfully updated port: fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-changed-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Refreshing instance network info cache due to event network-changed-fc02a82f-c678-49e6-8196-5213ef90e225. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:56:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance network_info: |[{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Refreshing network info cache for port fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start _get_guest_xml network_info=[{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:56:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:56:58 user nova-compute[72184]:   <uuid>1ba84814-1a19-453e-9482-3fae91ae857d</uuid>
Aug 01 16:56:58 user nova-compute[72184]:   <name>instance-00000013</name>
Aug 01 16:56:58 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:56:58 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:56:58 user nova-compute[72184]:   <metadata>
Aug 01 16:56:58 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:56:58 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:56:58 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherB-server-1980360680</nova:name>
Aug 01 16:56:58 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:56:58</nova:creationTime>
Aug 01 16:56:58 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:56:58 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:56:58 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:56:58 user nova-compute[72184]:       <nova:owner>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:user uuid="8cb37dea792d4fc98ac32d9c282020d6">tempest-ServerActionsTestOtherB-1303337288-project-member</nova:user>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:project uuid="955f909d63034bc8ace106364f8d9b96">tempest-ServerActionsTestOtherB-1303337288</nova:project>
Aug 01 16:56:58 user nova-compute[72184]:       </nova:owner>
Aug 01 16:56:58 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:56:58 user nova-compute[72184]:       <nova:ports>
Aug 01 16:56:58 user nova-compute[72184]:         <nova:port uuid="fc02a82f-c678-49e6-8196-5213ef90e225">
Aug 01 16:56:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 16:56:58 user nova-compute[72184]:         </nova:port>
Aug 01 16:56:58 user nova-compute[72184]:       </nova:ports>
Aug 01 16:56:58 user nova-compute[72184]:     </nova:instance>
Aug 01 16:56:58 user nova-compute[72184]:   </metadata>
Aug 01 16:56:58 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:56:58 user nova-compute[72184]:     <system>
Aug 01 16:56:58 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:56:58 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:56:58 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:56:58 user nova-compute[72184]:       <entry name="serial">1ba84814-1a19-453e-9482-3fae91ae857d</entry>
Aug 01 16:56:58 user nova-compute[72184]:       <entry name="uuid">1ba84814-1a19-453e-9482-3fae91ae857d</entry>
Aug 01 16:56:58 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:56:58 user nova-compute[72184]:     </system>
Aug 01 16:56:58 user nova-compute[72184]:   </sysinfo>
Aug 01 16:56:58 user nova-compute[72184]:   <os>
Aug 01 16:56:58 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:56:58 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:56:58 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:56:58 user nova-compute[72184]:   </os>
Aug 01 16:56:58 user nova-compute[72184]:   <features>
Aug 01 16:56:58 user nova-compute[72184]:     <acpi/>
Aug 01 16:56:58 user nova-compute[72184]:     <apic/>
Aug 01 16:56:58 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:56:58 user nova-compute[72184]:   </features>
Aug 01 16:56:58 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:56:58 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:56:58 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:56:58 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:56:58 user nova-compute[72184]:   </clock>
Aug 01 16:56:58 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:56:58 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:56:58 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:56:58 user nova-compute[72184]:   </cpu>
Aug 01 16:56:58 user nova-compute[72184]:   <devices>
Aug 01 16:56:58 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:56:58 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:56:58 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk"/>
Aug 01 16:56:58 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:56:58 user nova-compute[72184]:     </disk>
Aug 01 16:56:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:56:58 user nova-compute[72184]:       <mac address="fa:16:3e:0f:89:fd"/>
Aug 01 16:56:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:56:58 user nova-compute[72184]:       <target dev="tapfc02a82f-c6"/>
Aug 01 16:56:58 user nova-compute[72184]:     </interface>
Aug 01 16:56:58 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:56:58 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/console.log" append="off"/>
Aug 01 16:56:58 user nova-compute[72184]:     </serial>
Aug 01 16:56:58 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:56:58 user nova-compute[72184]:     <video>
Aug 01 16:56:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:56:58 user nova-compute[72184]:     </video>
Aug 01 16:56:58 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:56:58 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:56:58 user nova-compute[72184]:     </rng>
Aug 01 16:56:58 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:56:58 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:56:58 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:56:58 user nova-compute[72184]:     </memballoon>
Aug 01 16:56:58 user nova-compute[72184]:   </devices>
Aug 01 16:56:58 user nova-compute[72184]: </domain>
Aug 01 16:56:58 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG os_vif [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc02a82f-c6, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc02a82f-c6, col_values=(('external_ids', {'iface-id': 'fc02a82f-c678-49e6-8196-5213ef90e225', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:89:fd', 'vm-uuid': '1ba84814-1a19-453e-9482-3fae91ae857d'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:58 user nova-compute[72184]: INFO os_vif [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6')
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No VIF found with MAC fa:16:3e:0f:89:fd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:56:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updated VIF entry in instance network info cache for port fc02a82f-c678-49e6-8196-5213ef90e225. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:56:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:56:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a25d36ac-1d8c-4ab8-8fdf-cb13acc09d4f req-b372cf33-bb21-4ef4-b55f-d966d6a55dc0 service nova] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:56:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:56:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-b3fe0fe7-bd71-4cb1-b4e4-08b6f73f14f3 req-e84f0ef5-57ea-4e68-a527-be342fb1ee63 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b3fe0fe7-bd71-4cb1-b4e4-08b6f73f14f3 req-e84f0ef5-57ea-4e68-a527-be342fb1ee63 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b3fe0fe7-bd71-4cb1-b4e4-08b6f73f14f3 req-e84f0ef5-57ea-4e68-a527-be342fb1ee63 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b3fe0fe7-bd71-4cb1-b4e4-08b6f73f14f3 req-e84f0ef5-57ea-4e68-a527-be342fb1ee63 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-b3fe0fe7-bd71-4cb1-b4e4-08b6f73f14f3 req-e84f0ef5-57ea-4e68-a527-be342fb1ee63 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:00 user nova-compute[72184]: WARNING nova.compute.manager [req-b3fe0fe7-bd71-4cb1-b4e4-08b6f73f14f3 req-e84f0ef5-57ea-4e68-a527-be342fb1ee63 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state building and task_state spawning.
Aug 01 16:57:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:01 user nova-compute[72184]: INFO nova.compute.manager [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Detaching volume e04c93e9-f21c-4136-965d-2e566039948d
Aug 01 16:57:01 user nova-compute[72184]: INFO nova.virt.block_device [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Attempting to driver detach volume e04c93e9-f21c-4136-965d-2e566039948d from mountpoint /dev/vdb
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Attempting to detach device vdb from instance 8d331546-ccb4-4794-b3b8-ef5049640db6 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:57:01 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:57:01 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 16:57:01 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:57:01 user nova-compute[72184]:   <serial>e04c93e9-f21c-4136-965d-2e566039948d</serial>
Aug 01 16:57:01 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:57:01 user nova-compute[72184]: </disk>
Aug 01 16:57:01 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:57:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully detached device vdb from instance 8d331546-ccb4-4794-b3b8-ef5049640db6 from the persistent domain config.
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d331546-ccb4-4794-b3b8-ef5049640db6 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:57:01 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:57:01 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 16:57:01 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:57:01 user nova-compute[72184]:   <serial>e04c93e9-f21c-4136-965d-2e566039948d</serial>
Aug 01 16:57:01 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:57:01 user nova-compute[72184]: </disk>
Aug 01 16:57:01 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909021.854853, 8d331546-ccb4-4794-b3b8-ef5049640db6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:57:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully detached device vdb from instance 8d331546-ccb4-4794-b3b8-ef5049640db6 from the live domain config.
Aug 01 16:57:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzkNRXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:57:01 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98380e76-ee2a-4101-abeb-4e3723c16a16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d524f-74b5-4037-997d-c4ecb67ff8fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:57:01 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:57:01 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:57:01 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:57:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:57:01 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:57:01 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:57:01 user nova-compute[72184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d (non-flash)
Aug 01 16:57:01 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8666b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d'): ({'sde'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Removing single pathed devices sde {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6189b56c-556b-42eb-b56b-76f6aa145c91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71283c8-b9dc-4f4a-9ed1-93b4dd275b6a]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flushing IO for device /dev/sde {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdb5cb8-1edb-47d3-8a11-f7e22acc010e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54bec8-7167-44a5-88e7-915f07fe0d44]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e342253c-5aaf-4987-aab9-5c37fee98401]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-65172f72-258a-413e-a1f6-75d424315aff req-b2ed584c-d626-41c0-be8e-8ea3c0681f87 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-65172f72-258a-413e-a1f6-75d424315aff req-b2ed584c-d626-41c0-be8e-8ea3c0681f87 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-65172f72-258a-413e-a1f6-75d424315aff req-b2ed584c-d626-41c0-be8e-8ea3c0681f87 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-65172f72-258a-413e-a1f6-75d424315aff req-b2ed584c-d626-41c0-be8e-8ea3c0681f87 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-65172f72-258a-413e-a1f6-75d424315aff req-b2ed584c-d626-41c0-be8e-8ea3c0681f87 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:02 user nova-compute[72184]: WARNING nova.compute.manager [req-65172f72-258a-413e-a1f6-75d424315aff req-b2ed584c-d626-41c0-be8e-8ea3c0681f87 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state building and task_state spawning.
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7b15e-f2f0-475c-9ab6-560b091211c5]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260]
Aug 01 16:57:02 user nova-compute[72184]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d, portal: 172.16.0.220,3260] successful.
Aug 01 16:57:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04c93e9-f21c-4136-965d-2e566039948d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be458b-733a-4c3d-88ae-684c26e41624]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== disconnect_volume: return (369ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909022.3200004, 1ba84814-1a19-453e-9482-3fae91ae857d => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Resumed (Lifecycle Event)
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance spawned successfully.
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909022.3218184, 1ba84814-1a19-453e-9482-3fae91ae857d => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Started (Lifecycle Event)
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 01 16:57:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:02 user nova-compute[72184]: INFO nova.compute.manager [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Took 8.52 seconds to build instance.
Aug 01 16:57:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7452cf25-6dd2-4a9f-bb95-c5ab916d2568 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.668s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e0f18935-9adc-4311-b0e2-8d006b2ab198 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.079s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:57:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:57:32 user nova-compute[72184]: INFO nova.compute.claims [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Claim successful on node user
Aug 01 16:57:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:57:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.policy [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09d472678ed94cb7ab09de7d72128f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0982d76ca40a48b457e0797d6837b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:57:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Creating image(s)
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.177s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk 1073741824" returned: 0 in 0.057s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:34 user nova-compute[72184]: INFO nova.compute.manager [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Terminating instance
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Cannot resize image /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'migration_context' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Ensure instance console log exists: /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-a2ec2b21-02ac-4eb9-ac1f-eef03983958d req-1432bd58-2362-43a5-b898-618ff20d1007 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-vif-unplugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a2ec2b21-02ac-4eb9-ac1f-eef03983958d req-1432bd58-2362-43a5-b898-618ff20d1007 service nova] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a2ec2b21-02ac-4eb9-ac1f-eef03983958d req-1432bd58-2362-43a5-b898-618ff20d1007 service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a2ec2b21-02ac-4eb9-ac1f-eef03983958d req-1432bd58-2362-43a5-b898-618ff20d1007 service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-a2ec2b21-02ac-4eb9-ac1f-eef03983958d req-1432bd58-2362-43a5-b898-618ff20d1007 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] No waiting events found dispatching network-vif-unplugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-a2ec2b21-02ac-4eb9-ac1f-eef03983958d req-1432bd58-2362-43a5-b898-618ff20d1007 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-vif-unplugged-cb9adf79-31cf-4d90-b271-f243d6d1558b for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Instance destroyed successfully.
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'resources' on Instance uuid 6b5f0090-73c9-44f2-b989-28a3084daa58 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-643154892',display_name='tempest-VolumesAdminNegativeTest-server-643154892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-643154892',id=17,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b25e02b908e24e88b6ab9e0b86fdc699',ramdisk_id='',reservation_id='r-jw3lxrc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1181939340',owner_user_name='tempest-VolumesAdminNegativeTest-1181939340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:55:42Z,user_data=None,user_id='a36b28188247476b9b2f08c735a9089c',uuid=6b5f0090-73c9-44f2-b989-28a3084daa58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converting VIF {"id": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "address": "fa:16:3e:ed:a1:c5", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9adf79-31", "ovs_interfaceid": "cb9adf79-31cf-4d90-b271-f243d6d1558b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG os_vif [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb9adf79-31, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:35 user nova-compute[72184]: INFO os_vif [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a1:c5,bridge_name='br-int',has_traffic_filtering=True,id=cb9adf79-31cf-4d90-b271-f243d6d1558b,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9adf79-31')
Aug 01 16:57:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Deleting instance files /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58_del
Aug 01 16:57:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Deletion of /opt/stack/data/nova/instances/6b5f0090-73c9-44f2-b989-28a3084daa58_del complete
Aug 01 16:57:35 user nova-compute[72184]: INFO nova.compute.manager [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 16:57:35 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Successfully created port: d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:57:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:36 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Took 0.91 seconds to deallocate network for instance.
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-2355e3c5-b4b2-44f2-8743-ed7b5fe83291 req-69490024-b6e3-451d-9a61-61987c32757b service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-vif-deleted-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:36 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Deleted allocations for instance 6b5f0090-73c9-44f2-b989-28a3084daa58
Aug 01 16:57:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-0a8bdc5c-22bb-4c52-87ec-2f9e643e32e1 req-337085e2-77d3-4d33-8881-21f09e33fba6 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received event network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0a8bdc5c-22bb-4c52-87ec-2f9e643e32e1 req-337085e2-77d3-4d33-8881-21f09e33fba6 service nova] Acquiring lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0a8bdc5c-22bb-4c52-87ec-2f9e643e32e1 req-337085e2-77d3-4d33-8881-21f09e33fba6 service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0a8bdc5c-22bb-4c52-87ec-2f9e643e32e1 req-337085e2-77d3-4d33-8881-21f09e33fba6 service nova] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-0a8bdc5c-22bb-4c52-87ec-2f9e643e32e1 req-337085e2-77d3-4d33-8881-21f09e33fba6 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] No waiting events found dispatching network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:36 user nova-compute[72184]: WARNING nova.compute.manager [req-0a8bdc5c-22bb-4c52-87ec-2f9e643e32e1 req-337085e2-77d3-4d33-8881-21f09e33fba6 service nova] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Received unexpected event network-vif-plugged-cb9adf79-31cf-4d90-b271-f243d6d1558b for instance with vm_state deleted and task_state None.
Aug 01 16:57:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c26e1de9-1ec8-4960-b4a0-f7dc10b70074 tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "6b5f0090-73c9-44f2-b989-28a3084daa58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Successfully updated port: d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquired lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-changed-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Refreshing instance network info cache due to event network-changed-d8c311e0-0221-4d18-8579-f30e351d6ad5. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] Acquiring lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Releasing lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance network_info: |[{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] Acquired lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.neutron [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Refreshing network info cache for port d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Start _get_guest_xml network_info=[{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:57:37 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:57:37 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-163759626',display_name='tempest-ServerActionsTestOtherA-server-163759626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-163759626',id=20,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-smryrd3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=99df3b11-5b8e-4d64-bd50-fd9a4a7f821f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'pci_devices' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:57:37 user nova-compute[72184]:   <uuid>99df3b11-5b8e-4d64-bd50-fd9a4a7f821f</uuid>
Aug 01 16:57:37 user nova-compute[72184]:   <name>instance-00000014</name>
Aug 01 16:57:37 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:57:37 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:57:37 user nova-compute[72184]:   <metadata>
Aug 01 16:57:37 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:57:37 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:57:37 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherA-server-163759626</nova:name>
Aug 01 16:57:37 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:57:37</nova:creationTime>
Aug 01 16:57:37 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:57:37 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:57:37 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:57:37 user nova-compute[72184]:       <nova:owner>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:user uuid="09d472678ed94cb7ab09de7d72128f84">tempest-ServerActionsTestOtherA-2143698002-project-member</nova:user>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:project uuid="3ef0982d76ca40a48b457e0797d6837b">tempest-ServerActionsTestOtherA-2143698002</nova:project>
Aug 01 16:57:37 user nova-compute[72184]:       </nova:owner>
Aug 01 16:57:37 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:57:37 user nova-compute[72184]:       <nova:ports>
Aug 01 16:57:37 user nova-compute[72184]:         <nova:port uuid="d8c311e0-0221-4d18-8579-f30e351d6ad5">
Aug 01 16:57:37 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 16:57:37 user nova-compute[72184]:         </nova:port>
Aug 01 16:57:37 user nova-compute[72184]:       </nova:ports>
Aug 01 16:57:37 user nova-compute[72184]:     </nova:instance>
Aug 01 16:57:37 user nova-compute[72184]:   </metadata>
Aug 01 16:57:37 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:57:37 user nova-compute[72184]:     <system>
Aug 01 16:57:37 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:57:37 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:57:37 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:57:37 user nova-compute[72184]:       <entry name="serial">99df3b11-5b8e-4d64-bd50-fd9a4a7f821f</entry>
Aug 01 16:57:37 user nova-compute[72184]:       <entry name="uuid">99df3b11-5b8e-4d64-bd50-fd9a4a7f821f</entry>
Aug 01 16:57:37 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:57:37 user nova-compute[72184]:     </system>
Aug 01 16:57:37 user nova-compute[72184]:   </sysinfo>
Aug 01 16:57:37 user nova-compute[72184]:   <os>
Aug 01 16:57:37 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:57:37 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:57:37 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:57:37 user nova-compute[72184]:   </os>
Aug 01 16:57:37 user nova-compute[72184]:   <features>
Aug 01 16:57:37 user nova-compute[72184]:     <acpi/>
Aug 01 16:57:37 user nova-compute[72184]:     <apic/>
Aug 01 16:57:37 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:57:37 user nova-compute[72184]:   </features>
Aug 01 16:57:37 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:57:37 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:57:37 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:57:37 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:57:37 user nova-compute[72184]:   </clock>
Aug 01 16:57:37 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:57:37 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:57:37 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:57:37 user nova-compute[72184]:   </cpu>
Aug 01 16:57:37 user nova-compute[72184]:   <devices>
Aug 01 16:57:37 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:57:37 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:57:37 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk"/>
Aug 01 16:57:37 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:57:37 user nova-compute[72184]:     </disk>
Aug 01 16:57:37 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:57:37 user nova-compute[72184]:       <mac address="fa:16:3e:f4:23:78"/>
Aug 01 16:57:37 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:57:37 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:57:37 user nova-compute[72184]:       <target dev="tapd8c311e0-02"/>
Aug 01 16:57:37 user nova-compute[72184]:     </interface>
Aug 01 16:57:37 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:57:37 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/console.log" append="off"/>
Aug 01 16:57:37 user nova-compute[72184]:     </serial>
Aug 01 16:57:37 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:57:37 user nova-compute[72184]:     <video>
Aug 01 16:57:37 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:57:37 user nova-compute[72184]:     </video>
Aug 01 16:57:37 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:57:37 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:57:37 user nova-compute[72184]:     </rng>
Aug 01 16:57:37 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:57:37 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:57:37 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:57:37 user nova-compute[72184]:     </memballoon>
Aug 01 16:57:37 user nova-compute[72184]:   </devices>
Aug 01 16:57:37 user nova-compute[72184]: </domain>
Aug 01 16:57:37 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-163759626',display_name='tempest-ServerActionsTestOtherA-server-163759626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-163759626',id=20,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-smryrd3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=99df3b11-5b8e-4d64-bd50-fd9a4a7f821f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG os_vif [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c311e0-02, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c311e0-02, col_values=(('external_ids', {'iface-id': 'd8c311e0-0221-4d18-8579-f30e351d6ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:23:78', 'vm-uuid': '99df3b11-5b8e-4d64-bd50-fd9a4a7f821f'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:37 user nova-compute[72184]: INFO os_vif [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02')
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:57:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No VIF found with MAC fa:16:3e:f4:23:78, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:57:38 user nova-compute[72184]: DEBUG nova.network.neutron [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updated VIF entry in instance network info cache for port d8c311e0-0221-4d18-8579-f30e351d6ad5. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:57:38 user nova-compute[72184]: DEBUG nova.network.neutron [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-22c284b2-b637-43a4-8a75-75e2afa5dc49 req-bc62f346-958f-42e8-822b-1ca48068f4cc service nova] Releasing lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-ec698b35-1289-4d53-bed7-8827c5054431 req-f74c56c9-fdfd-4970-9afb-ecc4c308a5c6 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ec698b35-1289-4d53-bed7-8827c5054431 req-f74c56c9-fdfd-4970-9afb-ecc4c308a5c6 service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ec698b35-1289-4d53-bed7-8827c5054431 req-f74c56c9-fdfd-4970-9afb-ecc4c308a5c6 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ec698b35-1289-4d53-bed7-8827c5054431 req-f74c56c9-fdfd-4970-9afb-ecc4c308a5c6 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-ec698b35-1289-4d53-bed7-8827c5054431 req-f74c56c9-fdfd-4970-9afb-ecc4c308a5c6 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:39 user nova-compute[72184]: WARNING nova.compute.manager [req-ec698b35-1289-4d53-bed7-8827c5054431 req-f74c56c9-fdfd-4970-9afb-ecc4c308a5c6 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state building and task_state spawning.
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:57:39 user nova-compute[72184]: INFO nova.compute.claims [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Claim successful on node user
Aug 01 16:57:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:57:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.policy [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ae2243c375e4f23a9bb9d3abaab63cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793a9d1897f42be86ed38b4dff4f977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:57:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Creating image(s)
Aug 01 16:57:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "1af170f99a0a8e216dbd220df64945f02d79fa6e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "1af170f99a0a8e216dbd220df64945f02d79fa6e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Successfully created port: 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.part --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.images [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] e826beb3-bd81-44a6-91a5-d7ecf5c60160 was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.part /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909061.4422493, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] VM Resumed (Lifecycle Event)
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-c0875eba-c4a1-4586-8899-6e4941ec3f7a req-84b1e9f1-c2dc-44d3-a2ca-25ba84a8472a service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c0875eba-c4a1-4586-8899-6e4941ec3f7a req-84b1e9f1-c2dc-44d3-a2ca-25ba84a8472a service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c0875eba-c4a1-4586-8899-6e4941ec3f7a req-84b1e9f1-c2dc-44d3-a2ca-25ba84a8472a service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c0875eba-c4a1-4586-8899-6e4941ec3f7a req-84b1e9f1-c2dc-44d3-a2ca-25ba84a8472a service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-c0875eba-c4a1-4586-8899-6e4941ec3f7a req-84b1e9f1-c2dc-44d3-a2ca-25ba84a8472a service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:41 user nova-compute[72184]: WARNING nova.compute.manager [req-c0875eba-c4a1-4586-8899-6e4941ec3f7a req-84b1e9f1-c2dc-44d3-a2ca-25ba84a8472a service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state building and task_state spawning.
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance spawned successfully.
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.part /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.converted" returned: 0 in 0.319s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909061.4455025, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] VM Started (Lifecycle Event)
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "1af170f99a0a8e216dbd220df64945f02d79fa6e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.124s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Took 7.91 seconds to spawn the instance on the hypervisor.
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "1af170f99a0a8e216dbd220df64945f02d79fa6e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "1af170f99a0a8e216dbd220df64945f02d79fa6e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Successfully updated port: 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:57:41 user nova-compute[72184]: INFO nova.compute.manager [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Took 8.97 seconds to build instance.
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing instance network info cache due to event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-399213d3-1e58-46c4-b768-afed8fcfd239 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.077s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e,backing_fmt=raw /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e,backing_fmt=raw /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk 1073741824" returned: 0 in 0.047s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "1af170f99a0a8e216dbd220df64945f02d79fa6e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json" returned: 0 in 0.171s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance network_info: |[{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.neutron [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Cannot resize image /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'migration_context' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Ensure instance console log exists: /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Start _get_guest_xml network_info=[{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:57:37Z,direct_url=<?>,disk_format='qcow2',id=e826beb3-bd81-44a6-91a5-d7ecf5c60160,min_disk=0,min_ram=0,name='tempest-scenario-img--304560485',owner='d793a9d1897f42be86ed38b4dff4f977',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:57:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'e826beb3-bd81-44a6-91a5-d7ecf5c60160'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:57:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:57:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:57:37Z,direct_url=<?>,disk_format='qcow2',id=e826beb3-bd81-44a6-91a5-d7ecf5c60160,min_disk=0,min_ram=0,name='tempest-scenario-img--304560485',owner='d793a9d1897f42be86ed38b4dff4f977',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:57:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612266205',display_name='tempest-TestMinimumBasicScenario-server-612266205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612266205',id=21,image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5nPvYMhC5rR/sBonwGmp5lxGTG4O5MHsd6ezhFpv87E9ob3ikbZTyQpqjLXBG5Zs3u83C8VYktVbBI/H7Or9/KMDAmOrEZfqKTo2rhRSesYE8upRrvHg05hc/XfhVgWA==',key_name='tempest-TestMinimumBasicScenario-1780885707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-6179r134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:57:40Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=64db4084-3f8d-4f1a-87f7-99a86671fdd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'pci_devices' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:57:42 user nova-compute[72184]:   <uuid>64db4084-3f8d-4f1a-87f7-99a86671fdd1</uuid>
Aug 01 16:57:42 user nova-compute[72184]:   <name>instance-00000015</name>
Aug 01 16:57:42 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:57:42 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:57:42 user nova-compute[72184]:   <metadata>
Aug 01 16:57:42 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:57:42 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:57:42 user nova-compute[72184]:       <nova:name>tempest-TestMinimumBasicScenario-server-612266205</nova:name>
Aug 01 16:57:42 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:57:42</nova:creationTime>
Aug 01 16:57:42 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:57:42 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:57:42 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:57:42 user nova-compute[72184]:       <nova:owner>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:user uuid="9ae2243c375e4f23a9bb9d3abaab63cc">tempest-TestMinimumBasicScenario-582463682-project-member</nova:user>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:project uuid="d793a9d1897f42be86ed38b4dff4f977">tempest-TestMinimumBasicScenario-582463682</nova:project>
Aug 01 16:57:42 user nova-compute[72184]:       </nova:owner>
Aug 01 16:57:42 user nova-compute[72184]:       <nova:root type="image" uuid="e826beb3-bd81-44a6-91a5-d7ecf5c60160"/>
Aug 01 16:57:42 user nova-compute[72184]:       <nova:ports>
Aug 01 16:57:42 user nova-compute[72184]:         <nova:port uuid="3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8">
Aug 01 16:57:42 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 16:57:42 user nova-compute[72184]:         </nova:port>
Aug 01 16:57:42 user nova-compute[72184]:       </nova:ports>
Aug 01 16:57:42 user nova-compute[72184]:     </nova:instance>
Aug 01 16:57:42 user nova-compute[72184]:   </metadata>
Aug 01 16:57:42 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:57:42 user nova-compute[72184]:     <system>
Aug 01 16:57:42 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:57:42 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:57:42 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:57:42 user nova-compute[72184]:       <entry name="serial">64db4084-3f8d-4f1a-87f7-99a86671fdd1</entry>
Aug 01 16:57:42 user nova-compute[72184]:       <entry name="uuid">64db4084-3f8d-4f1a-87f7-99a86671fdd1</entry>
Aug 01 16:57:42 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:57:42 user nova-compute[72184]:     </system>
Aug 01 16:57:42 user nova-compute[72184]:   </sysinfo>
Aug 01 16:57:42 user nova-compute[72184]:   <os>
Aug 01 16:57:42 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:57:42 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:57:42 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:57:42 user nova-compute[72184]:   </os>
Aug 01 16:57:42 user nova-compute[72184]:   <features>
Aug 01 16:57:42 user nova-compute[72184]:     <acpi/>
Aug 01 16:57:42 user nova-compute[72184]:     <apic/>
Aug 01 16:57:42 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:57:42 user nova-compute[72184]:   </features>
Aug 01 16:57:42 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:57:42 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:57:42 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:57:42 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:57:42 user nova-compute[72184]:   </clock>
Aug 01 16:57:42 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:57:42 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:57:42 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:57:42 user nova-compute[72184]:   </cpu>
Aug 01 16:57:42 user nova-compute[72184]:   <devices>
Aug 01 16:57:42 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:57:42 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:57:42 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk"/>
Aug 01 16:57:42 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:57:42 user nova-compute[72184]:     </disk>
Aug 01 16:57:42 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:57:42 user nova-compute[72184]:       <mac address="fa:16:3e:6e:9c:91"/>
Aug 01 16:57:42 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:57:42 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:57:42 user nova-compute[72184]:       <target dev="tap3d9c3dfc-14"/>
Aug 01 16:57:42 user nova-compute[72184]:     </interface>
Aug 01 16:57:42 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:57:42 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/console.log" append="off"/>
Aug 01 16:57:42 user nova-compute[72184]:     </serial>
Aug 01 16:57:42 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:57:42 user nova-compute[72184]:     <video>
Aug 01 16:57:42 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:57:42 user nova-compute[72184]:     </video>
Aug 01 16:57:42 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:57:42 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:57:42 user nova-compute[72184]:     </rng>
Aug 01 16:57:42 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:57:42 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:57:42 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:57:42 user nova-compute[72184]:     </memballoon>
Aug 01 16:57:42 user nova-compute[72184]:   </devices>
Aug 01 16:57:42 user nova-compute[72184]: </domain>
Aug 01 16:57:42 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612266205',display_name='tempest-TestMinimumBasicScenario-server-612266205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612266205',id=21,image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5nPvYMhC5rR/sBonwGmp5lxGTG4O5MHsd6ezhFpv87E9ob3ikbZTyQpqjLXBG5Zs3u83C8VYktVbBI/H7Or9/KMDAmOrEZfqKTo2rhRSesYE8upRrvHg05hc/XfhVgWA==',key_name='tempest-TestMinimumBasicScenario-1780885707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-6179r134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:57:40Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=64db4084-3f8d-4f1a-87f7-99a86671fdd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG os_vif [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d9c3dfc-14, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d9c3dfc-14, col_values=(('external_ids', {'iface-id': '3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:9c:91', 'vm-uuid': '64db4084-3f8d-4f1a-87f7-99a86671fdd1'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:42 user nova-compute[72184]: INFO os_vif [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14')
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No VIF found with MAC fa:16:3e:6e:9c:91, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.neutron [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updated VIF entry in instance network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG nova.network.neutron [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-33d0c8e5-4575-4faf-8172-575e7d99dba2 req-087a1a87-1861-47b0-a31f-18201bc835cc service nova] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-74148143-b9c0-4099-87ba-1d4751fc7d04 req-d8ecd082-9a3f-4965-b4ee-737148cec7f5 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-74148143-b9c0-4099-87ba-1d4751fc7d04 req-d8ecd082-9a3f-4965-b4ee-737148cec7f5 service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-74148143-b9c0-4099-87ba-1d4751fc7d04 req-d8ecd082-9a3f-4965-b4ee-737148cec7f5 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-74148143-b9c0-4099-87ba-1d4751fc7d04 req-d8ecd082-9a3f-4965-b4ee-737148cec7f5 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-74148143-b9c0-4099-87ba-1d4751fc7d04 req-d8ecd082-9a3f-4965-b4ee-737148cec7f5 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:44 user nova-compute[72184]: WARNING nova.compute.manager [req-74148143-b9c0-4099-87ba-1d4751fc7d04 req-d8ecd082-9a3f-4965-b4ee-737148cec7f5 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state building and task_state spawning.
Aug 01 16:57:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909066.2185814, 64db4084-3f8d-4f1a-87f7-99a86671fdd1 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] VM Resumed (Lifecycle Event)
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance spawned successfully.
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909066.221978, 64db4084-3f8d-4f1a-87f7-99a86671fdd1 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] VM Started (Lifecycle Event)
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9cfbeaa-a7e3-43fa-b651-5bc17c02c18f req-26f96c7b-e8f5-492d-87ef-d06659a42a36 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9cfbeaa-a7e3-43fa-b651-5bc17c02c18f req-26f96c7b-e8f5-492d-87ef-d06659a42a36 service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9cfbeaa-a7e3-43fa-b651-5bc17c02c18f req-26f96c7b-e8f5-492d-87ef-d06659a42a36 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9cfbeaa-a7e3-43fa-b651-5bc17c02c18f req-26f96c7b-e8f5-492d-87ef-d06659a42a36 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9cfbeaa-a7e3-43fa-b651-5bc17c02c18f req-26f96c7b-e8f5-492d-87ef-d06659a42a36 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:46 user nova-compute[72184]: WARNING nova.compute.manager [req-d9cfbeaa-a7e3-43fa-b651-5bc17c02c18f req-26f96c7b-e8f5-492d-87ef-d06659a42a36 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state building and task_state spawning.
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 01 16:57:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:46 user nova-compute[72184]: INFO nova.compute.manager [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Took 6.66 seconds to build instance.
Aug 01 16:57:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e56657ce-ae5a-46a5-ab0e-21dd9d0cf35b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909055.1061838, 6b5f0090-73c9-44f2-b989-28a3084daa58 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:57:50 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] VM Stopped (Lifecycle Event)
Aug 01 16:57:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6951c4cc-53b6-4225-b68f-98a27295ba49 None None] [instance: 6b5f0090-73c9-44f2-b989-28a3084daa58] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:51 user nova-compute[72184]: INFO nova.compute.manager [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Terminating instance
Aug 01 16:57:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-729f58bb-7cba-49f7-84dc-6083d8fdf64f req-cecc4600-19e8-46fd-933b-d77a1a5f81d3 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-vif-unplugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-729f58bb-7cba-49f7-84dc-6083d8fdf64f req-cecc4600-19e8-46fd-933b-d77a1a5f81d3 service nova] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-729f58bb-7cba-49f7-84dc-6083d8fdf64f req-cecc4600-19e8-46fd-933b-d77a1a5f81d3 service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-729f58bb-7cba-49f7-84dc-6083d8fdf64f req-cecc4600-19e8-46fd-933b-d77a1a5f81d3 service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-729f58bb-7cba-49f7-84dc-6083d8fdf64f req-cecc4600-19e8-46fd-933b-d77a1a5f81d3 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] No waiting events found dispatching network-vif-unplugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-729f58bb-7cba-49f7-84dc-6083d8fdf64f req-cecc4600-19e8-46fd-933b-d77a1a5f81d3 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-vif-unplugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:52 user nova-compute[72184]: INFO nova.compute.manager [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Terminating instance
Aug 01 16:57:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Instance destroyed successfully.
Aug 01 16:57:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:57:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:57:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=6857MB free_disk=25.176971435546875GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'resources' on Instance uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-316335542',display_name='tempest-AttachVolumeNegativeTest-server-316335542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-316335542',id=6,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiR7kc3NyKOWFq+fqjHZPnGt0Lo256a/PvNUfxMjRWQXpWl/WW4Qk7BsOwwYjDbnYAo9p/vabvgAicd/UCH8COe1ZlAxGNJxD2YoJ7ON7PQUAQWGkVE48yjB3Q4+EPx9g==',key_name='tempest-keypair-313393892',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-b0w30oze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=8d331546-ccb4-4794-b3b8-ef5049640db6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "address": "fa:16:3e:64:52:f0", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c07b8d-e3", "ovs_interfaceid": "05c07b8d-e31d-4dce-8b1b-ac6047c29540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_vif [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05c07b8d-e3, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: INFO os_vif [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:52:f0,bridge_name='br-int',has_traffic_filtering=True,id=05c07b8d-e31d-4dce-8b1b-ac6047c29540,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c07b8d-e3')
Aug 01 16:57:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Deleting instance files /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6_del
Aug 01 16:57:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Deletion of /opt/stack/data/nova/instances/8d331546-ccb4-4794-b3b8-ef5049640db6_del complete
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: INFO nova.compute.manager [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 7b407b54-6887-4b20-a3ae-50a2ce5777be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 70e188c4-72bc-4842-bb3f-a9d611c38164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 9944d144-6f02-4d7b-993d-9d80639dbb76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 11dbc561-2543-456f-a729-16fc2fc42127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Instance destroyed successfully.
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'resources' on Instance uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T16:54:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-894135068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-939615552',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKERJF4uaqhkevsOU0CTgv4cvmtOfkduxIFnR4IKMKEFoDveR2Y4WHtOig0qbK7Z3yz4nDK8w978Pm6Z3P1G4EQBHH6UmbCg42YzbkboRMW939x/8GEQInnkfQK23WBviQ==',key_name='tempest-keypair-890600544',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-voymav9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=9944d144-6f02-4d7b-993d-9d80639dbb76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "415b8e1b-0e0d-4209-b151-4474047270e8", "address": "fa:16:3e:b3:c4:6a", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415b8e1b-0e", "ovs_interfaceid": "415b8e1b-0e0d-4209-b151-4474047270e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_vif [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap415b8e1b-0e, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:57:53 user nova-compute[72184]: INFO os_vif [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c4:6a,bridge_name='br-int',has_traffic_filtering=True,id=415b8e1b-0e0d-4209-b151-4474047270e8,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415b8e1b-0e')
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNQucFjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:57:53 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbecb481-4d22-4b64-a74f-fbb611ead240]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.879s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed7310-5c11-42fd-8ec9-4ef6e78a81ea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:57:53 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:57:53 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:57:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:57:53 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:57:53 user nova-compute[72184]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 (non-flash)
Aug 01 16:57:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30182e6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef16c3c8-db53-46ea-8851-fe97cf838da6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc33bfdf-b584-4448-b603-4412b3ec167c]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc1e50e-a667-45f4-90e3-c6a6edcd5ddc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432f203-f4a2-4837-aa1c-e9b2c877d090]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7e3d722-eb302dbd848b8c0e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7e3d722', '/dev/disk/by-id/scsi-26562333032646264') {{(pid=83397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 16:57:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e2fdb7-dec7-4c64-91ea-62792b1f645a]: (4, None) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8159888d-4787-4c60-9ac5-c56556af25fe]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:54 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Took 0.91 seconds to deallocate network for instance.
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-48aff912-33a9-470b-9e9e-4bf05efc2917 req-e10ba6d5-3f88-4b5e-a8bd-e3d090097446 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-vif-deleted-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:54 user nova-compute[72184]: INFO nova.compute.manager [req-48aff912-33a9-470b-9e9e-4bf05efc2917 req-e10ba6d5-3f88-4b5e-a8bd-e3d090097446 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Neutron deleted interface 05c07b8d-e31d-4dce-8b1b-ac6047c29540; detaching it from the instance and deleting it from the info cache
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-48aff912-33a9-470b-9e9e-4bf05efc2917 req-e10ba6d5-3f88-4b5e-a8bd-e3d090097446 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-48aff912-33a9-470b-9e9e-4bf05efc2917 req-e10ba6d5-3f88-4b5e-a8bd-e3d090097446 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Detach interface failed, port_id=05c07b8d-e31d-4dce-8b1b-ac6047c29540, reason: Instance 8d331546-ccb4-4794-b3b8-ef5049640db6 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Skipping network cache update for instance because it is being deleted. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received event network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] No waiting events found dispatching network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:54 user nova-compute[72184]: WARNING nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Received unexpected event network-vif-plugged-05c07b8d-e31d-4dce-8b1b-ac6047c29540 for instance with vm_state active and task_state deleting.
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-unplugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-unplugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-unplugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] No waiting events found dispatching network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:57:54 user nova-compute[72184]: WARNING nova.compute.manager [req-b403a2cc-2d9f-4d1a-878b-cce337a3ad91 req-dcaf9db7-e334-4412-95ac-2200844a90f7 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received unexpected event network-vif-plugged-415b8e1b-0e0d-4209-b151-4474047270e8 for instance with vm_state active and task_state deleting.
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf3159-4555-4ea0-9963-edb4116b29d4]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260]
Aug 01 16:57:54 user nova-compute[72184]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480, portal: 172.16.0.220,3260] successful.
Aug 01 16:57:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e024d764-d153-4abd-9082-22daa0510480 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05d1b12-b320-48f2-904c-359c11dd65e9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] <== disconnect_volume: return (338ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:57:54 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Deleting instance files /opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76_del
Aug 01 16:57:54 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Deletion of /opt/stack/data/nova/instances/9944d144-6f02-4d7b-993d-9d80639dbb76_del complete
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:57:54 user nova-compute[72184]: INFO nova.compute.manager [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Took 1.89 seconds to destroy the instance on the hypervisor.
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Deleted allocations for instance 8d331546-ccb4-4794-b3b8-ef5049640db6
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-abcb38b7-7f2b-4b08-b425-9086c7e539a6 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.146s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: WARNING nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] While synchronizing instance power states, found 14 instances in the database and 12 instances on the hypervisor.
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 202a214d-94fc-4748-a403-abdbc75a4157 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 76785510-2f39-4b4f-a11c-d30f9cd82138 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 7b407b54-6887-4b20-a3ae-50a2ce5777be {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 8d331546-ccb4-4794-b3b8-ef5049640db6 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 9944d144-6f02-4d7b-993d-9d80639dbb76 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "202a214d-94fc-4748-a403-abdbc75a4157" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "8d331546-ccb4-4794-b3b8-ef5049640db6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "9944d144-6f02-4d7b-993d-9d80639dbb76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "11dbc561-2543-456f-a729-16fc2fc42127" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 16:57:54 user nova-compute[72184]: WARNING oslo_messaging._drivers.amqpdriver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "8d331546-ccb4-4794-b3b8-ef5049640db6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "202a214d-94fc-4748-a403-abdbc75a4157" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.162s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "11dbc561-2543-456f-a729-16fc2fc42127" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:57:55 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-d95a56bd-3852-48db-a7a7-f11011669e7d req-07fe9cae-ee3c-4ead-9931-45df6674df12 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Received event network-vif-deleted-415b8e1b-0e0d-4209-b151-4474047270e8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:55 user nova-compute[72184]: INFO nova.compute.manager [req-d95a56bd-3852-48db-a7a7-f11011669e7d req-07fe9cae-ee3c-4ead-9931-45df6674df12 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Neutron deleted interface 415b8e1b-0e0d-4209-b151-4474047270e8; detaching it from the instance and deleting it from the info cache
Aug 01 16:57:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-d95a56bd-3852-48db-a7a7-f11011669e7d req-07fe9cae-ee3c-4ead-9931-45df6674df12 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:55 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Took 1.29 seconds to deallocate network for instance.
Aug 01 16:57:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-d95a56bd-3852-48db-a7a7-f11011669e7d req-07fe9cae-ee3c-4ead-9931-45df6674df12 service nova] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Detach interface failed, port_id=415b8e1b-0e0d-4209-b151-4474047270e8, reason: Instance 9944d144-6f02-4d7b-993d-9d80639dbb76 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:57:56 user nova-compute[72184]: INFO nova.compute.manager [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Took 0.75 seconds to detach 1 volumes for instance.
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Deleting volume: e024d764-d153-4abd-9082-22daa0510480 {{(pid=72184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-changed-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Refreshing instance network info cache due to event network-changed-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] Acquiring lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] Acquired lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Refreshing network info cache for port 4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updated VIF entry in instance network info cache for port 4ed9cdf5-62d0-4df7-a7ce-f185da297f8d. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "interface-11dbc561-2543-456f-a729-16fc2fc42127-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "interface-11dbc561-2543-456f-a729-16fc2fc42127-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG nova.objects.instance [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'flavor' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e942c7ce-5d62-4c69-99f7-6c82c263e2a0 req-c63e0a77-bab9-4b24-84ca-822a74eae63c service nova] Releasing lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:57 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Deleted allocations for instance 9944d144-6f02-4d7b-993d-9d80639dbb76
Aug 01 16:57:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-3a3f1fdd-8a1d-4406-be73-7dbe4b780eed tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.781s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.273s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:57:57 user nova-compute[72184]: INFO nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 01 16:57:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "9944d144-6f02-4d7b-993d-9d80639dbb76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'pci_requests' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:57:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:57:57 user nova-compute[72184]: DEBUG nova.policy [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fb14a139a3d49adb000837495669841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df99c9ee2284aee92507254f44b1d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:57:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Successfully created port: ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Successfully updated port: ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquired lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-changed-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Refreshing instance network info cache due to event network-changed-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] Acquiring lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Releasing lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] Acquired lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Refreshing network info cache for port ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG os_vif [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee214eb6-2b, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee214eb6-2b, col_values=(('external_ids', {'iface-id': 'ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:f5:4b', 'vm-uuid': '11dbc561-2543-456f-a729-16fc2fc42127'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: INFO os_vif [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b')
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:57:59 user nova-compute[72184]: INFO nova.compute.manager [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Unrescuing
Aug 01 16:57:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] attach device xml: <interface type="ethernet">
Aug 01 16:57:59 user nova-compute[72184]:   <mac address="fa:16:3e:73:f5:4b"/>
Aug 01 16:57:59 user nova-compute[72184]:   <model type="virtio"/>
Aug 01 16:57:59 user nova-compute[72184]:   <mtu size="1442"/>
Aug 01 16:57:59 user nova-compute[72184]:   <target dev="tapee214eb6-2b"/>
Aug 01 16:57:59 user nova-compute[72184]: </interface>
Aug 01 16:57:59 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No BDM found with device name hda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No VIF found with MAC fa:16:3e:58:35:96, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:57:59 user nova-compute[72184]:   <nova:package version="0.0.0"/>
Aug 01 16:57:59 user nova-compute[72184]:   <nova:name>tempest-device-tagging-server-538405060</nova:name>
Aug 01 16:57:59 user nova-compute[72184]:   <nova:creationTime>2023-08-01 16:57:59</nova:creationTime>
Aug 01 16:57:59 user nova-compute[72184]:   <nova:flavor name="m1.tiny">
Aug 01 16:57:59 user nova-compute[72184]:     <nova:memory>512</nova:memory>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:disk>1</nova:disk>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:swap>0</nova:swap>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:vcpus>1</nova:vcpus>
Aug 01 16:57:59 user nova-compute[72184]:   </nova:flavor>
Aug 01 16:57:59 user nova-compute[72184]:   <nova:owner>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:user uuid="9fb14a139a3d49adb000837495669841">tempest-TaggedAttachmentsTest-759872684-project-member</nova:user>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:project uuid="7df99c9ee2284aee92507254f44b1d72">tempest-TaggedAttachmentsTest-759872684</nova:project>
Aug 01 16:57:59 user nova-compute[72184]:   </nova:owner>
Aug 01 16:57:59 user nova-compute[72184]:   <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:57:59 user nova-compute[72184]:   <nova:ports>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:port uuid="4ed9cdf5-62d0-4df7-a7ce-f185da297f8d">
Aug 01 16:57:59 user nova-compute[72184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:57:59 user nova-compute[72184]:     </nova:port>
Aug 01 16:57:59 user nova-compute[72184]:     <nova:port uuid="ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8">
Aug 01 16:57:59 user nova-compute[72184]:       <nova:ip type="fixed" address="10.10.10.4" ipVersion="4"/>
Aug 01 16:57:59 user nova-compute[72184]:     </nova:port>
Aug 01 16:57:59 user nova-compute[72184]:   </nova:ports>
Aug 01 16:57:59 user nova-compute[72184]: </nova:instance>
Aug 01 16:57:59 user nova-compute[72184]:  {{(pid=72184) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updated VIF entry in instance network info cache for port ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54dc98f1-8baf-455e-98ff-428931785846 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "interface-11dbc561-2543-456f-a729-16fc2fc42127-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.957s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:57:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-92bcce72-2330-4b02-acbd-9d3b8c42ec02 req-c74d4cf4-eae9-4c88-9c4e-ae3a66bb43e0 service nova] Releasing lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-407faf0e-2730-494e-a1bb-9d2e511714be req-1be384b3-f16e-4df9-af4c-0d6020e4b8af service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-407faf0e-2730-494e-a1bb-9d2e511714be req-1be384b3-f16e-4df9-af4c-0d6020e4b8af service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-407faf0e-2730-494e-a1bb-9d2e511714be req-1be384b3-f16e-4df9-af4c-0d6020e4b8af service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-407faf0e-2730-494e-a1bb-9d2e511714be req-1be384b3-f16e-4df9-af4c-0d6020e4b8af service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-407faf0e-2730-494e-a1bb-9d2e511714be req-1be384b3-f16e-4df9-af4c-0d6020e4b8af service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:00 user nova-compute[72184]: WARNING nova.compute.manager [req-407faf0e-2730-494e-a1bb-9d2e511714be req-1be384b3-f16e-4df9-af4c-0d6020e4b8af service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 for instance with vm_state active and task_state None.
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'flavor' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'flavor' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:00 user nova-compute[72184]: INFO nova.compute.manager [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Attaching volume 4bd7b6cc-f10c-4b13-a063-00874028f2e3 to /dev/vdb
Aug 01 16:58:00 user nova-compute[72184]: DEBUG os_brick.utils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325cc8b-7114-401b-a93e-3cb5ba0b4453]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf5058b-1605-4687-9897-d30706946c78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[360ba514-7a5b-4892-94aa-560bd2167834]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf3cb39-5b50-460c-8e1a-1385a46d6366]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:58:01 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78717dd6-48f2-4d12-acd6-4d1d38c71b98]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG os_brick.utils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating existing volume attachment record: 167a56fc-5baf-4095-a0e1-d97df118f293 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:58:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance destroyed successfully.
Aug 01 16:58:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-02d50d6b-b48e-4319-9541-1ccdabf0d7c5 req-8314bbc0-c201-4be1-804c-061232f0ddb6 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-02d50d6b-b48e-4319-9541-1ccdabf0d7c5 req-8314bbc0-c201-4be1-804c-061232f0ddb6 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-02d50d6b-b48e-4319-9541-1ccdabf0d7c5 req-8314bbc0-c201-4be1-804c-061232f0ddb6 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-02d50d6b-b48e-4319-9541-1ccdabf0d7c5 req-8314bbc0-c201-4be1-804c-061232f0ddb6 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-02d50d6b-b48e-4319-9541-1ccdabf0d7c5 req-8314bbc0-c201-4be1-804c-061232f0ddb6 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:01 user nova-compute[72184]: WARNING nova.compute.manager [req-02d50d6b-b48e-4319-9541-1ccdabf0d7c5 req-8314bbc0-c201-4be1-804c-061232f0ddb6 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-a5b0af49-0b57-481d-98ed-a86878e8af3b req-27497fe4-1da9-4700-8ab5-7ed3d2196ee2 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a5b0af49-0b57-481d-98ed-a86878e8af3b req-27497fe4-1da9-4700-8ab5-7ed3d2196ee2 service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a5b0af49-0b57-481d-98ed-a86878e8af3b req-27497fe4-1da9-4700-8ab5-7ed3d2196ee2 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a5b0af49-0b57-481d-98ed-a86878e8af3b req-27497fe4-1da9-4700-8ab5-7ed3d2196ee2 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-a5b0af49-0b57-481d-98ed-a86878e8af3b req-27497fe4-1da9-4700-8ab5-7ed3d2196ee2 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:02 user nova-compute[72184]: WARNING nova.compute.manager [req-a5b0af49-0b57-481d-98ed-a86878e8af3b req-27497fe4-1da9-4700-8ab5-7ed3d2196ee2 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 for instance with vm_state active and task_state None.
Aug 01 16:58:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:03 user nova-compute[72184]: WARNING nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing instance network info cache due to event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updated VIF entry in instance network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing instance network info cache due to event network-changed-2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Acquiring lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Acquired lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Refreshing network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updated VIF entry in instance network info cache for port 2d8ec797-0e9e-4016-983f-aca7420380b2. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [{"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Releasing lock "refresh_cache-a70ead3f-68f7-4be2-acbd-b5b4f6501a54" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:04 user nova-compute[72184]: WARNING nova.compute.manager [req-3b71a909-61a1-49b7-ab4e-a5a0cd515f47 req-48f5f0b0-d42a-45dd-a667-386cec50e777 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for a70ead3f-68f7-4be2-acbd-b5b4f6501a54 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909085.3717763, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:05 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Resumed (Lifecycle Event)
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ae2d5a9a-0067-43b9-a8b1-bfabbb5f9e84 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:05 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909085.3780475, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:05 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Started (Lifecycle Event)
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-e4765473-204f-4f32-8f9f-a9e97681fea2 req-46dae332-f58a-432f-85d2-c809ae69d805 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e4765473-204f-4f32-8f9f-a9e97681fea2 req-46dae332-f58a-432f-85d2-c809ae69d805 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e4765473-204f-4f32-8f9f-a9e97681fea2 req-46dae332-f58a-432f-85d2-c809ae69d805 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e4765473-204f-4f32-8f9f-a9e97681fea2 req-46dae332-f58a-432f-85d2-c809ae69d805 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-e4765473-204f-4f32-8f9f-a9e97681fea2 req-46dae332-f58a-432f-85d2-c809ae69d805 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:05 user nova-compute[72184]: WARNING nova.compute.manager [req-e4765473-204f-4f32-8f9f-a9e97681fea2 req-46dae332-f58a-432f-85d2-c809ae69d805 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state active and task_state None.
Aug 01 16:58:07 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909072.6210084, 8d331546-ccb4-4794-b3b8-ef5049640db6 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:07 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] VM Stopped (Lifecycle Event)
Aug 01 16:58:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f35cc4f0-d418-4e8c-a789-1d0e71741661 None None] [instance: 8d331546-ccb4-4794-b3b8-ef5049640db6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:08 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909073.7495034, 9944d144-6f02-4d7b-993d-9d80639dbb76 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:08 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] VM Stopped (Lifecycle Event)
Aug 01 16:58:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a5b2351-d413-40f1-9f3e-b1a6f97bd52d None None] [instance: 9944d144-6f02-4d7b-993d-9d80639dbb76] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvHLQzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:58:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:58:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:58:09 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[589d48ea-ec83-484d-8bed-08f2b977801b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:58:09 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c5c8f-e81b-4abc-ac73-4a79c33b22c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3] added
Aug 01 16:58:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202674b-d05e-43ab-98b7-a2de5972b687]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ad7db6-ddcc-440d-8598-2e968b878638]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFvHLQzM {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFvHLQzM" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28916d32-15af-41ab-b831-99020e99705a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFvHLQzM'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dfd351-82ff-46bc-b2b2-880d0a800b27]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1f1a8-14bf-4ec4-8180-3fdaa1dc5be8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:09 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:09 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0961a0d-2f9f-44b2-ada2-48ab6cca2dcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260]
Aug 01 16:58:09 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260] successful.
Aug 01 16:58:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bf770a-a80d-461f-81a3-5bd01d1a2d8e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee41a0-6b41-47a9-b2a5-9ebb51337556]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:09 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:09 user nova-compute[72184]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 (non-flash)
Aug 01 16:58:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:09 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:09 user nova-compute[72184]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 (non-flash)
Aug 01 16:58:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d95c9-0208-465d-831f-7cdc723c33e3]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:58:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvHLQzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:58:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:58:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23230326530613238', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:58:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230326530613238', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:58:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'flavor' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:58:10 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:58:10 user nova-compute[72184]:   <source dev="/dev/sdc"/>
Aug 01 16:58:10 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:58:10 user nova-compute[72184]:   <serial>4bd7b6cc-f10c-4b13-a063-00874028f2e3</serial>
Aug 01 16:58:10 user nova-compute[72184]: </disk>
Aug 01 16:58:10 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:58:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:58:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No BDM found with device name hda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:58:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] No VIF found with MAC fa:16:3e:58:35:96, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:58:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75693c58-23cc-4a07-8bfa-c9814aa60d42 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.525s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:12 user nova-compute[72184]: INFO nova.compute.manager [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Detaching volume 4bd7b6cc-f10c-4b13-a063-00874028f2e3
Aug 01 16:58:12 user nova-compute[72184]: INFO nova.virt.block_device [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Attempting to driver detach volume 4bd7b6cc-f10c-4b13-a063-00874028f2e3 from mountpoint /dev/vdb
Aug 01 16:58:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Attempting to detach device vdb from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:58:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:58:12 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:58:12 user nova-compute[72184]:   <source dev="/dev/sdc"/>
Aug 01 16:58:12 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:58:12 user nova-compute[72184]:   <serial>4bd7b6cc-f10c-4b13-a063-00874028f2e3</serial>
Aug 01 16:58:12 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 16:58:12 user nova-compute[72184]: </disk>
Aug 01 16:58:12 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:58:12 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully detached device vdb from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the persistent domain config.
Aug 01 16:58:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:58:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:58:12 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:58:12 user nova-compute[72184]:   <source dev="/dev/sdc"/>
Aug 01 16:58:12 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:58:12 user nova-compute[72184]:   <serial>4bd7b6cc-f10c-4b13-a063-00874028f2e3</serial>
Aug 01 16:58:12 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 16:58:12 user nova-compute[72184]: </disk>
Aug 01 16:58:12 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909093.0237665, 11dbc561-2543-456f-a729-16fc2fc42127 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:58:13 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully detached device vdb from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the live domain config.
Aug 01 16:58:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvHLQzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:58:13 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33524de3-b917-49c9-8135-fefad971477c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddea637-417f-47d0-844e-e7777440058e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:13 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:13 user nova-compute[72184]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 (non-flash)
Aug 01 16:58:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:13 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:13 user nova-compute[72184]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 (non-flash)
Aug 01 16:58:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff85e32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f52763e-4fb2-4ebd-8caa-4e8fda5472e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57de6c4-32c3-42cc-ac90-50e13fc19e77]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[183fcfd2-78eb-4993-bffb-608431002459]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7879c8-cf56-470f-99da-ac7b099ec39f]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10f6b1e-d01a-43a6-9e68-8f53088497d1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc27f7d-6007-493e-827c-92b0e2304f0a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260]
Aug 01 16:58:13 user nova-compute[72184]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3, portal: 172.16.0.220,3260] successful.
Aug 01 16:58:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd7b6cc-f10c-4b13-a063-00874028f2e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c263872-52be-4fd7-9f14-11d07c4d3e42]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] <== disconnect_volume: return (274ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:58:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'flavor' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2b5347df-4a3d-4946-bed9-2dd14063830f tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "interface-11dbc561-2543-456f-a729-16fc2fc42127-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "interface-11dbc561-2543-456f-a729-16fc2fc42127-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.objects.instance [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'flavor' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:f5:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapee214eb6-2b"/></interface> {{(pid=72184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:f5:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapee214eb6-2b"/></interface> {{(pid=72184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Attempting to detach device tapee214eb6-2b from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] detach device xml: <interface type="ethernet">
Aug 01 16:58:14 user nova-compute[72184]:   <mac address="fa:16:3e:73:f5:4b"/>
Aug 01 16:58:14 user nova-compute[72184]:   <model type="virtio"/>
Aug 01 16:58:14 user nova-compute[72184]:   <mtu size="1442"/>
Aug 01 16:58:14 user nova-compute[72184]:   <target dev="tapee214eb6-2b"/>
Aug 01 16:58:14 user nova-compute[72184]: </interface>
Aug 01 16:58:14 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:f5:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapee214eb6-2b"/></interface> {{(pid=72184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:73:f5:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapee214eb6-2b"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 01 16:58:14 user nova-compute[72184]:   <name>instance-00000012</name>
Aug 01 16:58:14 user nova-compute[72184]:   <uuid>11dbc561-2543-456f-a729-16fc2fc42127</uuid>
Aug 01 16:58:14 user nova-compute[72184]:   <metadata>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:58:14 user nova-compute[72184]:   <nova:package version="0.0.0"/>
Aug 01 16:58:14 user nova-compute[72184]:   <nova:name>tempest-device-tagging-server-538405060</nova:name>
Aug 01 16:58:14 user nova-compute[72184]:   <nova:creationTime>2023-08-01 16:57:59</nova:creationTime>
Aug 01 16:58:14 user nova-compute[72184]:   <nova:flavor name="m1.tiny">
Aug 01 16:58:14 user nova-compute[72184]:     <nova:memory>512</nova:memory>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:disk>1</nova:disk>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:swap>0</nova:swap>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:vcpus>1</nova:vcpus>
Aug 01 16:58:14 user nova-compute[72184]:   </nova:flavor>
Aug 01 16:58:14 user nova-compute[72184]:   <nova:owner>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:user uuid="9fb14a139a3d49adb000837495669841">tempest-TaggedAttachmentsTest-759872684-project-member</nova:user>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:project uuid="7df99c9ee2284aee92507254f44b1d72">tempest-TaggedAttachmentsTest-759872684</nova:project>
Aug 01 16:58:14 user nova-compute[72184]:   </nova:owner>
Aug 01 16:58:14 user nova-compute[72184]:   <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:58:14 user nova-compute[72184]:   <nova:ports>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:port uuid="4ed9cdf5-62d0-4df7-a7ce-f185da297f8d">
Aug 01 16:58:14 user nova-compute[72184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:58:14 user nova-compute[72184]:     </nova:port>
Aug 01 16:58:14 user nova-compute[72184]:     <nova:port uuid="ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8">
Aug 01 16:58:14 user nova-compute[72184]:       <nova:ip type="fixed" address="10.10.10.4" ipVersion="4"/>
Aug 01 16:58:14 user nova-compute[72184]:     </nova:port>
Aug 01 16:58:14 user nova-compute[72184]:   </nova:ports>
Aug 01 16:58:14 user nova-compute[72184]: </nova:instance>
Aug 01 16:58:14 user nova-compute[72184]:   </metadata>
Aug 01 16:58:14 user nova-compute[72184]:   <memory unit='KiB'>524288</memory>
Aug 01 16:58:14 user nova-compute[72184]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 16:58:14 user nova-compute[72184]:   <vcpu placement='static'>1</vcpu>
Aug 01 16:58:14 user nova-compute[72184]:   <resource>
Aug 01 16:58:14 user nova-compute[72184]:     <partition>/machine</partition>
Aug 01 16:58:14 user nova-compute[72184]:   </resource>
Aug 01 16:58:14 user nova-compute[72184]:   <sysinfo type='smbios'>
Aug 01 16:58:14 user nova-compute[72184]:     <system>
Aug 01 16:58:14 user nova-compute[72184]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 16:58:14 user nova-compute[72184]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 16:58:14 user nova-compute[72184]:       <entry name='version'>0.0.0</entry>
Aug 01 16:58:14 user nova-compute[72184]:       <entry name='serial'>11dbc561-2543-456f-a729-16fc2fc42127</entry>
Aug 01 16:58:14 user nova-compute[72184]:       <entry name='uuid'>11dbc561-2543-456f-a729-16fc2fc42127</entry>
Aug 01 16:58:14 user nova-compute[72184]:       <entry name='family'>Virtual Machine</entry>
Aug 01 16:58:14 user nova-compute[72184]:     </system>
Aug 01 16:58:14 user nova-compute[72184]:   </sysinfo>
Aug 01 16:58:14 user nova-compute[72184]:   <os>
Aug 01 16:58:14 user nova-compute[72184]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 16:58:14 user nova-compute[72184]:     <boot dev='hd'/>
Aug 01 16:58:14 user nova-compute[72184]:     <smbios mode='sysinfo'/>
Aug 01 16:58:14 user nova-compute[72184]:   </os>
Aug 01 16:58:14 user nova-compute[72184]:   <features>
Aug 01 16:58:14 user nova-compute[72184]:     <acpi/>
Aug 01 16:58:14 user nova-compute[72184]:     <apic/>
Aug 01 16:58:14 user nova-compute[72184]:     <vmcoreinfo state='on'/>
Aug 01 16:58:14 user nova-compute[72184]:   </features>
Aug 01 16:58:14 user nova-compute[72184]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 16:58:14 user nova-compute[72184]:     <model fallback='forbid'>Nehalem</model>
Aug 01 16:58:14 user nova-compute[72184]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 16:58:14 user nova-compute[72184]:     <feature policy='require' name='vme'/>
Aug 01 16:58:14 user nova-compute[72184]:     <feature policy='require' name='x2apic'/>
Aug 01 16:58:14 user nova-compute[72184]:     <feature policy='require' name='hypervisor'/>
Aug 01 16:58:14 user nova-compute[72184]:   </cpu>
Aug 01 16:58:14 user nova-compute[72184]:   <clock offset='utc'>
Aug 01 16:58:14 user nova-compute[72184]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 16:58:14 user nova-compute[72184]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 16:58:14 user nova-compute[72184]:     <timer name='hpet' present='no'/>
Aug 01 16:58:14 user nova-compute[72184]:   </clock>
Aug 01 16:58:14 user nova-compute[72184]:   <on_poweroff>destroy</on_poweroff>
Aug 01 16:58:14 user nova-compute[72184]:   <on_reboot>restart</on_reboot>
Aug 01 16:58:14 user nova-compute[72184]:   <on_crash>destroy</on_crash>
Aug 01 16:58:14 user nova-compute[72184]:   <devices>
Aug 01 16:58:14 user nova-compute[72184]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 16:58:14 user nova-compute[72184]:     <disk type='file' device='disk'>
Aug 01 16:58:14 user nova-compute[72184]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 16:58:14 user nova-compute[72184]:       <source file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk' index='2'/>
Aug 01 16:58:14 user nova-compute[72184]:       <backingStore type='file' index='3'>
Aug 01 16:58:14 user nova-compute[72184]:         <format type='raw'/>
Aug 01 16:58:14 user nova-compute[72184]:         <source file='/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080'/>
Aug 01 16:58:14 user nova-compute[72184]:         <backingStore/>
Aug 01 16:58:14 user nova-compute[72184]:       </backingStore>
Aug 01 16:58:14 user nova-compute[72184]:       <target dev='vda' bus='virtio'/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='virtio-disk0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </disk>
Aug 01 16:58:14 user nova-compute[72184]:     <disk type='file' device='cdrom'>
Aug 01 16:58:14 user nova-compute[72184]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 16:58:14 user nova-compute[72184]:       <source file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.config' index='1'/>
Aug 01 16:58:14 user nova-compute[72184]:       <backingStore/>
Aug 01 16:58:14 user nova-compute[72184]:       <target dev='hda' bus='ide'/>
Aug 01 16:58:14 user nova-compute[72184]:       <readonly/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='ide0-0-0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </disk>
Aug 01 16:58:14 user nova-compute[72184]:     <controller type='usb' index='0' model='none'>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='usb'/>
Aug 01 16:58:14 user nova-compute[72184]:     </controller>
Aug 01 16:58:14 user nova-compute[72184]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='pci.0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </controller>
Aug 01 16:58:14 user nova-compute[72184]:     <controller type='ide' index='0'>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='ide'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 16:58:14 user nova-compute[72184]:     </controller>
Aug 01 16:58:14 user nova-compute[72184]:     <interface type='ethernet'>
Aug 01 16:58:14 user nova-compute[72184]:       <mac address='fa:16:3e:58:35:96'/>
Aug 01 16:58:14 user nova-compute[72184]:       <target dev='tap4ed9cdf5-62'/>
Aug 01 16:58:14 user nova-compute[72184]:       <model type='virtio'/>
Aug 01 16:58:14 user nova-compute[72184]:       <mtu size='1442'/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='net0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </interface>
Aug 01 16:58:14 user nova-compute[72184]:     <interface type='ethernet'>
Aug 01 16:58:14 user nova-compute[72184]:       <mac address='fa:16:3e:73:f5:4b'/>
Aug 01 16:58:14 user nova-compute[72184]:       <target dev='tapee214eb6-2b'/>
Aug 01 16:58:14 user nova-compute[72184]:       <model type='virtio'/>
Aug 01 16:58:14 user nova-compute[72184]:       <mtu size='1442'/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='net1'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </interface>
Aug 01 16:58:14 user nova-compute[72184]:     <serial type='pty'>
Aug 01 16:58:14 user nova-compute[72184]:       <source path='/dev/pts/6'/>
Aug 01 16:58:14 user nova-compute[72184]:       <log file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/console.log' append='off'/>
Aug 01 16:58:14 user nova-compute[72184]:       <target type='isa-serial' port='0'>
Aug 01 16:58:14 user nova-compute[72184]:         <model name='isa-serial'/>
Aug 01 16:58:14 user nova-compute[72184]:       </target>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='serial0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </serial>
Aug 01 16:58:14 user nova-compute[72184]:     <console type='pty' tty='/dev/pts/6'>
Aug 01 16:58:14 user nova-compute[72184]:       <source path='/dev/pts/6'/>
Aug 01 16:58:14 user nova-compute[72184]:       <log file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/console.log' append='off'/>
Aug 01 16:58:14 user nova-compute[72184]:       <target type='serial' port='0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='serial0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </console>
Aug 01 16:58:14 user nova-compute[72184]:     <input type='mouse' bus='ps2'>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='input0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </input>
Aug 01 16:58:14 user nova-compute[72184]:     <input type='keyboard' bus='ps2'>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='input1'/>
Aug 01 16:58:14 user nova-compute[72184]:     </input>
Aug 01 16:58:14 user nova-compute[72184]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 01 16:58:14 user nova-compute[72184]:       <listen type='address' address='0.0.0.0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </graphics>
Aug 01 16:58:14 user nova-compute[72184]:     <audio id='1' type='none'/>
Aug 01 16:58:14 user nova-compute[72184]:     <video>
Aug 01 16:58:14 user nova-compute[72184]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='video0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </video>
Aug 01 16:58:14 user nova-compute[72184]:     <memballoon model='virtio'>
Aug 01 16:58:14 user nova-compute[72184]:       <stats period='10'/>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='balloon0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </memballoon>
Aug 01 16:58:14 user nova-compute[72184]:     <rng model='virtio'>
Aug 01 16:58:14 user nova-compute[72184]:       <backend model='random'>/dev/urandom</backend>
Aug 01 16:58:14 user nova-compute[72184]:       <alias name='rng0'/>
Aug 01 16:58:14 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 16:58:14 user nova-compute[72184]:     </rng>
Aug 01 16:58:14 user nova-compute[72184]:   </devices>
Aug 01 16:58:14 user nova-compute[72184]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 16:58:14 user nova-compute[72184]:     <label>libvirt-11dbc561-2543-456f-a729-16fc2fc42127</label>
Aug 01 16:58:14 user nova-compute[72184]:     <imagelabel>libvirt-11dbc561-2543-456f-a729-16fc2fc42127</imagelabel>
Aug 01 16:58:14 user nova-compute[72184]:   </seclabel>
Aug 01 16:58:14 user nova-compute[72184]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 16:58:14 user nova-compute[72184]:     <label>+64055:+108</label>
Aug 01 16:58:14 user nova-compute[72184]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 16:58:14 user nova-compute[72184]:   </seclabel>
Aug 01 16:58:14 user nova-compute[72184]: </domain>
Aug 01 16:58:14 user nova-compute[72184]:  {{(pid=72184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 16:58:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully detached device tapee214eb6-2b from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the persistent domain config.
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] (1/8): Attempting to detach device tapee214eb6-2b with device alias net1 from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:58:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] detach device xml: <interface type="ethernet">
Aug 01 16:58:14 user nova-compute[72184]:   <mac address="fa:16:3e:73:f5:4b"/>
Aug 01 16:58:14 user nova-compute[72184]:   <model type="virtio"/>
Aug 01 16:58:14 user nova-compute[72184]:   <mtu size="1442"/>
Aug 01 16:58:14 user nova-compute[72184]:   <target dev="tapee214eb6-2b"/>
Aug 01 16:58:14 user nova-compute[72184]: </interface>
Aug 01 16:58:14 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909095.053314, 11dbc561-2543-456f-a729-16fc2fc42127 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Start waiting for the detach event from libvirt for device tapee214eb6-2b with device alias net1 for instance 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:f5:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapee214eb6-2b"/></interface> {{(pid=72184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:73:f5:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapee214eb6-2b"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 01 16:58:15 user nova-compute[72184]:   <name>instance-00000012</name>
Aug 01 16:58:15 user nova-compute[72184]:   <uuid>11dbc561-2543-456f-a729-16fc2fc42127</uuid>
Aug 01 16:58:15 user nova-compute[72184]:   <metadata>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:58:15 user nova-compute[72184]:   <nova:package version="0.0.0"/>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:name>tempest-device-tagging-server-538405060</nova:name>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:creationTime>2023-08-01 16:57:59</nova:creationTime>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:flavor name="m1.tiny">
Aug 01 16:58:15 user nova-compute[72184]:     <nova:memory>512</nova:memory>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:disk>1</nova:disk>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:swap>0</nova:swap>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:vcpus>1</nova:vcpus>
Aug 01 16:58:15 user nova-compute[72184]:   </nova:flavor>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:owner>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:user uuid="9fb14a139a3d49adb000837495669841">tempest-TaggedAttachmentsTest-759872684-project-member</nova:user>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:project uuid="7df99c9ee2284aee92507254f44b1d72">tempest-TaggedAttachmentsTest-759872684</nova:project>
Aug 01 16:58:15 user nova-compute[72184]:   </nova:owner>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:ports>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:port uuid="4ed9cdf5-62d0-4df7-a7ce-f185da297f8d">
Aug 01 16:58:15 user nova-compute[72184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:58:15 user nova-compute[72184]:     </nova:port>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:port uuid="ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8">
Aug 01 16:58:15 user nova-compute[72184]:       <nova:ip type="fixed" address="10.10.10.4" ipVersion="4"/>
Aug 01 16:58:15 user nova-compute[72184]:     </nova:port>
Aug 01 16:58:15 user nova-compute[72184]:   </nova:ports>
Aug 01 16:58:15 user nova-compute[72184]: </nova:instance>
Aug 01 16:58:15 user nova-compute[72184]:   </metadata>
Aug 01 16:58:15 user nova-compute[72184]:   <memory unit='KiB'>524288</memory>
Aug 01 16:58:15 user nova-compute[72184]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 16:58:15 user nova-compute[72184]:   <vcpu placement='static'>1</vcpu>
Aug 01 16:58:15 user nova-compute[72184]:   <resource>
Aug 01 16:58:15 user nova-compute[72184]:     <partition>/machine</partition>
Aug 01 16:58:15 user nova-compute[72184]:   </resource>
Aug 01 16:58:15 user nova-compute[72184]:   <sysinfo type='smbios'>
Aug 01 16:58:15 user nova-compute[72184]:     <system>
Aug 01 16:58:15 user nova-compute[72184]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 16:58:15 user nova-compute[72184]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 16:58:15 user nova-compute[72184]:       <entry name='version'>0.0.0</entry>
Aug 01 16:58:15 user nova-compute[72184]:       <entry name='serial'>11dbc561-2543-456f-a729-16fc2fc42127</entry>
Aug 01 16:58:15 user nova-compute[72184]:       <entry name='uuid'>11dbc561-2543-456f-a729-16fc2fc42127</entry>
Aug 01 16:58:15 user nova-compute[72184]:       <entry name='family'>Virtual Machine</entry>
Aug 01 16:58:15 user nova-compute[72184]:     </system>
Aug 01 16:58:15 user nova-compute[72184]:   </sysinfo>
Aug 01 16:58:15 user nova-compute[72184]:   <os>
Aug 01 16:58:15 user nova-compute[72184]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 16:58:15 user nova-compute[72184]:     <boot dev='hd'/>
Aug 01 16:58:15 user nova-compute[72184]:     <smbios mode='sysinfo'/>
Aug 01 16:58:15 user nova-compute[72184]:   </os>
Aug 01 16:58:15 user nova-compute[72184]:   <features>
Aug 01 16:58:15 user nova-compute[72184]:     <acpi/>
Aug 01 16:58:15 user nova-compute[72184]:     <apic/>
Aug 01 16:58:15 user nova-compute[72184]:     <vmcoreinfo state='on'/>
Aug 01 16:58:15 user nova-compute[72184]:   </features>
Aug 01 16:58:15 user nova-compute[72184]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 16:58:15 user nova-compute[72184]:     <model fallback='forbid'>Nehalem</model>
Aug 01 16:58:15 user nova-compute[72184]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 16:58:15 user nova-compute[72184]:     <feature policy='require' name='vme'/>
Aug 01 16:58:15 user nova-compute[72184]:     <feature policy='require' name='x2apic'/>
Aug 01 16:58:15 user nova-compute[72184]:     <feature policy='require' name='hypervisor'/>
Aug 01 16:58:15 user nova-compute[72184]:   </cpu>
Aug 01 16:58:15 user nova-compute[72184]:   <clock offset='utc'>
Aug 01 16:58:15 user nova-compute[72184]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 16:58:15 user nova-compute[72184]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 16:58:15 user nova-compute[72184]:     <timer name='hpet' present='no'/>
Aug 01 16:58:15 user nova-compute[72184]:   </clock>
Aug 01 16:58:15 user nova-compute[72184]:   <on_poweroff>destroy</on_poweroff>
Aug 01 16:58:15 user nova-compute[72184]:   <on_reboot>restart</on_reboot>
Aug 01 16:58:15 user nova-compute[72184]:   <on_crash>destroy</on_crash>
Aug 01 16:58:15 user nova-compute[72184]:   <devices>
Aug 01 16:58:15 user nova-compute[72184]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 16:58:15 user nova-compute[72184]:     <disk type='file' device='disk'>
Aug 01 16:58:15 user nova-compute[72184]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 16:58:15 user nova-compute[72184]:       <source file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk' index='2'/>
Aug 01 16:58:15 user nova-compute[72184]:       <backingStore type='file' index='3'>
Aug 01 16:58:15 user nova-compute[72184]:         <format type='raw'/>
Aug 01 16:58:15 user nova-compute[72184]:         <source file='/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080'/>
Aug 01 16:58:15 user nova-compute[72184]:         <backingStore/>
Aug 01 16:58:15 user nova-compute[72184]:       </backingStore>
Aug 01 16:58:15 user nova-compute[72184]:       <target dev='vda' bus='virtio'/>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='virtio-disk0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </disk>
Aug 01 16:58:15 user nova-compute[72184]:     <disk type='file' device='cdrom'>
Aug 01 16:58:15 user nova-compute[72184]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 16:58:15 user nova-compute[72184]:       <source file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk.config' index='1'/>
Aug 01 16:58:15 user nova-compute[72184]:       <backingStore/>
Aug 01 16:58:15 user nova-compute[72184]:       <target dev='hda' bus='ide'/>
Aug 01 16:58:15 user nova-compute[72184]:       <readonly/>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='ide0-0-0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </disk>
Aug 01 16:58:15 user nova-compute[72184]:     <controller type='usb' index='0' model='none'>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='usb'/>
Aug 01 16:58:15 user nova-compute[72184]:     </controller>
Aug 01 16:58:15 user nova-compute[72184]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='pci.0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </controller>
Aug 01 16:58:15 user nova-compute[72184]:     <controller type='ide' index='0'>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='ide'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 16:58:15 user nova-compute[72184]:     </controller>
Aug 01 16:58:15 user nova-compute[72184]:     <interface type='ethernet'>
Aug 01 16:58:15 user nova-compute[72184]:       <mac address='fa:16:3e:58:35:96'/>
Aug 01 16:58:15 user nova-compute[72184]:       <target dev='tap4ed9cdf5-62'/>
Aug 01 16:58:15 user nova-compute[72184]:       <model type='virtio'/>
Aug 01 16:58:15 user nova-compute[72184]:       <mtu size='1442'/>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='net0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </interface>
Aug 01 16:58:15 user nova-compute[72184]:     <serial type='pty'>
Aug 01 16:58:15 user nova-compute[72184]:       <source path='/dev/pts/6'/>
Aug 01 16:58:15 user nova-compute[72184]:       <log file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/console.log' append='off'/>
Aug 01 16:58:15 user nova-compute[72184]:       <target type='isa-serial' port='0'>
Aug 01 16:58:15 user nova-compute[72184]:         <model name='isa-serial'/>
Aug 01 16:58:15 user nova-compute[72184]:       </target>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='serial0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </serial>
Aug 01 16:58:15 user nova-compute[72184]:     <console type='pty' tty='/dev/pts/6'>
Aug 01 16:58:15 user nova-compute[72184]:       <source path='/dev/pts/6'/>
Aug 01 16:58:15 user nova-compute[72184]:       <log file='/opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/console.log' append='off'/>
Aug 01 16:58:15 user nova-compute[72184]:       <target type='serial' port='0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='serial0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </console>
Aug 01 16:58:15 user nova-compute[72184]:     <input type='mouse' bus='ps2'>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='input0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </input>
Aug 01 16:58:15 user nova-compute[72184]:     <input type='keyboard' bus='ps2'>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='input1'/>
Aug 01 16:58:15 user nova-compute[72184]:     </input>
Aug 01 16:58:15 user nova-compute[72184]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 01 16:58:15 user nova-compute[72184]:       <listen type='address' address='0.0.0.0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </graphics>
Aug 01 16:58:15 user nova-compute[72184]:     <audio id='1' type='none'/>
Aug 01 16:58:15 user nova-compute[72184]:     <video>
Aug 01 16:58:15 user nova-compute[72184]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='video0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </video>
Aug 01 16:58:15 user nova-compute[72184]:     <memballoon model='virtio'>
Aug 01 16:58:15 user nova-compute[72184]:       <stats period='10'/>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='balloon0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </memballoon>
Aug 01 16:58:15 user nova-compute[72184]:     <rng model='virtio'>
Aug 01 16:58:15 user nova-compute[72184]:       <backend model='random'>/dev/urandom</backend>
Aug 01 16:58:15 user nova-compute[72184]:       <alias name='rng0'/>
Aug 01 16:58:15 user nova-compute[72184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 16:58:15 user nova-compute[72184]:     </rng>
Aug 01 16:58:15 user nova-compute[72184]:   </devices>
Aug 01 16:58:15 user nova-compute[72184]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 16:58:15 user nova-compute[72184]:     <label>libvirt-11dbc561-2543-456f-a729-16fc2fc42127</label>
Aug 01 16:58:15 user nova-compute[72184]:     <imagelabel>libvirt-11dbc561-2543-456f-a729-16fc2fc42127</imagelabel>
Aug 01 16:58:15 user nova-compute[72184]:   </seclabel>
Aug 01 16:58:15 user nova-compute[72184]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 16:58:15 user nova-compute[72184]:     <label>+64055:+108</label>
Aug 01 16:58:15 user nova-compute[72184]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 16:58:15 user nova-compute[72184]:   </seclabel>
Aug 01 16:58:15 user nova-compute[72184]: </domain>
Aug 01 16:58:15 user nova-compute[72184]:  {{(pid=72184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 16:58:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully detached device tapee214eb6-2b from instance 11dbc561-2543-456f-a729-16fc2fc42127 from the live domain config.
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "address": "fa:16:3e:73:f5:4b", "network": {"id": "634d1f87-cac4-4962-b3f8-5b48d658e845", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1940501841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee214eb6-2b", "ovs_interfaceid": "ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG os_vif [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee214eb6-2b, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:15 user nova-compute[72184]: INFO os_vif [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:4b,bridge_name='br-int',has_traffic_filtering=True,id=ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8,network=Network(634d1f87-cac4-4962-b3f8-5b48d658e845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee214eb6-2b')
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:58:15 user nova-compute[72184]:   <nova:package version="0.0.0"/>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:name>tempest-device-tagging-server-538405060</nova:name>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:creationTime>2023-08-01 16:58:15</nova:creationTime>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:flavor name="m1.tiny">
Aug 01 16:58:15 user nova-compute[72184]:     <nova:memory>512</nova:memory>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:disk>1</nova:disk>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:swap>0</nova:swap>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:vcpus>1</nova:vcpus>
Aug 01 16:58:15 user nova-compute[72184]:   </nova:flavor>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:owner>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:user uuid="9fb14a139a3d49adb000837495669841">tempest-TaggedAttachmentsTest-759872684-project-member</nova:user>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:project uuid="7df99c9ee2284aee92507254f44b1d72">tempest-TaggedAttachmentsTest-759872684</nova:project>
Aug 01 16:58:15 user nova-compute[72184]:   </nova:owner>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:58:15 user nova-compute[72184]:   <nova:ports>
Aug 01 16:58:15 user nova-compute[72184]:     <nova:port uuid="4ed9cdf5-62d0-4df7-a7ce-f185da297f8d">
Aug 01 16:58:15 user nova-compute[72184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 16:58:15 user nova-compute[72184]:     </nova:port>
Aug 01 16:58:15 user nova-compute[72184]:   </nova:ports>
Aug 01 16:58:15 user nova-compute[72184]: </nova:instance>
Aug 01 16:58:15 user nova-compute[72184]:  {{(pid=72184) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-93e437c6-c8ae-4ac0-b59b-acf7c6f90fdd req-87d20e65-6a19-42cf-ab87-27a310abe658 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-unplugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-93e437c6-c8ae-4ac0-b59b-acf7c6f90fdd req-87d20e65-6a19-42cf-ab87-27a310abe658 service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-93e437c6-c8ae-4ac0-b59b-acf7c6f90fdd req-87d20e65-6a19-42cf-ab87-27a310abe658 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-93e437c6-c8ae-4ac0-b59b-acf7c6f90fdd req-87d20e65-6a19-42cf-ab87-27a310abe658 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-93e437c6-c8ae-4ac0-b59b-acf7c6f90fdd req-87d20e65-6a19-42cf-ab87-27a310abe658 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-unplugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:15 user nova-compute[72184]: WARNING nova.compute.manager [req-93e437c6-c8ae-4ac0-b59b-acf7c6f90fdd req-87d20e65-6a19-42cf-ab87-27a310abe658 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-unplugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 for instance with vm_state active and task_state None.
Aug 01 16:58:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquired lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:16 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:58:16 user nova-compute[72184]: INFO nova.network.neutron [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Port ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 01 16:58:16 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [{"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Releasing lock "refresh_cache-11dbc561-2543-456f-a729-16fc2fc42127" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d48ed89f-672b-4d9e-a907-f34b602eb151 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "interface-11dbc561-2543-456f-a729-16fc2fc42127-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.815s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:17 user nova-compute[72184]: WARNING nova.compute.manager [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-plugged-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 for instance with vm_state active and task_state None.
Aug 01 16:58:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b42d30b-b610-4b2b-9eb6-fb886ed014c8 req-68a51190-7e3d-49f4-812f-bdf320582ae9 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-deleted-ee214eb6-2b01-4fe7-bc9d-a39c1815d8a8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:28 user nova-compute[72184]: INFO nova.compute.manager [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Unrescuing
Aug 01 16:58:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:58:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:28 user nova-compute[72184]: DEBUG nova.objects.instance [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'flavor' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd84533d-ca5a-46c9-b704-05c8b3ade2f0 req-e9cfc79b-9dab-4690-845f-f5916412b80a service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd84533d-ca5a-46c9-b704-05c8b3ade2f0 req-e9cfc79b-9dab-4690-845f-f5916412b80a service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd84533d-ca5a-46c9-b704-05c8b3ade2f0 req-e9cfc79b-9dab-4690-845f-f5916412b80a service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd84533d-ca5a-46c9-b704-05c8b3ade2f0 req-e9cfc79b-9dab-4690-845f-f5916412b80a service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd84533d-ca5a-46c9-b704-05c8b3ade2f0 req-e9cfc79b-9dab-4690-845f-f5916412b80a service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:29 user nova-compute[72184]: WARNING nova.compute.manager [req-bd84533d-ca5a-46c9-b704-05c8b3ade2f0 req-e9cfc79b-9dab-4690-845f-f5916412b80a service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance destroyed successfully.
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:29 user nova-compute[72184]: INFO nova.compute.manager [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Terminating instance
Aug 01 16:58:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Instance destroyed successfully.
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.objects.instance [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lazy-loading 'resources' on Instance uuid 70e188c4-72bc-4842-bb3f-a9d611c38164 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1938253671',display_name='tempest-VolumesAdminNegativeTest-server-1938253671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1938253671',id=8,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRUmRcoanGo2ErsLnnB/e9dm/Uw4paBCn/BDiUKLlcd0L9GHnx7lJXTyKVT0cJwFZ1a9sz8cSyIZGsa642sC9RpZDs3e8IPiMIju0meTHvfE4aPBxYFnWsjrUNYcNGyNA==',key_name='tempest-keypair-1814341886',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b25e02b908e24e88b6ab9e0b86fdc699',ramdisk_id='',reservation_id='r-aq8gsu6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1181939340',owner_user_name='tempest-VolumesAdminNegativeTest-1181939340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a36b28188247476b9b2f08c735a9089c',uuid=70e188c4-72bc-4842-bb3f-a9d611c38164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converting VIF {"id": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "address": "fa:16:3e:3a:4a:d9", "network": {"id": "2f4b3597-8a5e-4326-adf2-cffa7d382743", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-380950113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b25e02b908e24e88b6ab9e0b86fdc699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c18de7-3c", "ovs_interfaceid": "36c18de7-3c3e-4a20-b6da-1916d8e12323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG os_vif [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36c18de7-3c, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: INFO os_vif [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4a:d9,bridge_name='br-int',has_traffic_filtering=True,id=36c18de7-3c3e-4a20-b6da-1916d8e12323,network=Network(2f4b3597-8a5e-4326-adf2-cffa7d382743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c18de7-3c')
Aug 01 16:58:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Deleting instance files /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164_del
Aug 01 16:58:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Deletion of /opt/stack/data/nova/instances/70e188c4-72bc-4842-bb3f-a9d611c38164_del complete
Aug 01 16:58:31 user nova-compute[72184]: INFO nova.compute.manager [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:31 user nova-compute[72184]: WARNING nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-vif-unplugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] No waiting events found dispatching network-vif-unplugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-vif-unplugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Acquiring lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] No waiting events found dispatching network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:31 user nova-compute[72184]: WARNING nova.compute.manager [req-c1aad4fd-db3b-4ef3-a70d-496c55bdbadc req-1b097278-4bba-4946-8978-1f4122defd8b service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received unexpected event network-vif-plugged-36c18de7-3c3e-4a20-b6da-1916d8e12323 for instance with vm_state active and task_state deleting.
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:31 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:32 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Took 0.82 seconds to deallocate network for instance.
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-ed4661d4-7f7e-4c14-9e83-c58c1e24fe2b req-01682c9e-1015-4f7c-a798-a3c147f8a85a service nova] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Received event network-vif-deleted-36c18de7-3c3e-4a20-b6da-1916d8e12323 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:58:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:32 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Deleted allocations for instance 70e188c4-72bc-4842-bb3f-a9d611c38164
Aug 01 16:58:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-011ef2a6-2f00-444c-b124-ef477e0bd92b tempest-VolumesAdminNegativeTest-1181939340 tempest-VolumesAdminNegativeTest-1181939340-project-member] Lock "70e188c4-72bc-4842-bb3f-a9d611c38164" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:33 user nova-compute[72184]: WARNING nova.compute.manager [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:33 user nova-compute[72184]: WARNING nova.compute.manager [req-0de5b453-53f2-464a-bd2b-4e98dbd7011b req-b3784e88-73d4-47b5-8c49-cdf69f2d0fd1 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 75c3c16a-8768-4b24-8469-35b77664a71e due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909113.6056864, 75c3c16a-8768-4b24-8469-35b77664a71e => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Resumed (Lifecycle Event)
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-72ba9c36-c13a-4c57-8e24-60506b214c4e tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909113.6069422, 75c3c16a-8768-4b24-8469-35b77664a71e => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Started (Lifecycle Event)
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:34 user nova-compute[72184]: INFO nova.compute.manager [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Detaching volume 56cde5f3-f122-4535-a57a-2ad98a50093b
Aug 01 16:58:34 user nova-compute[72184]: INFO nova.virt.block_device [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Attempting to driver detach volume 56cde5f3-f122-4535-a57a-2ad98a50093b from mountpoint /dev/vdb
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Attempting to detach device vdb from instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:58:34 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:58:34 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 16:58:34 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:58:34 user nova-compute[72184]:   <serial>56cde5f3-f122-4535-a57a-2ad98a50093b</serial>
Aug 01 16:58:34 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:58:34 user nova-compute[72184]: </disk>
Aug 01 16:58:34 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:58:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Successfully detached device vdb from instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 from the persistent domain config.
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:58:34 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:58:34 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 16:58:34 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:58:34 user nova-compute[72184]:   <serial>56cde5f3-f122-4535-a57a-2ad98a50093b</serial>
Aug 01 16:58:34 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:58:34 user nova-compute[72184]: </disk>
Aug 01 16:58:34 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909114.8237317, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:58:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Successfully detached device vdb from instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 from the live domain config.
Aug 01 16:58:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzBfdMYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:58:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd6b10d-1d36-4edf-b9be-8958df4080e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26524a9-3c18-4e8f-8e9e-3335d09bc58b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:34 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:58:34 user nova-compute[72184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b (non-flash)
Aug 01 16:58:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0e6fb5-15dc-4a54-9644-56e7b9ce0ebe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c95622-ddc5-489a-8c22-2dcb259fe499]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6d4a0e-0a0c-4b19-9b7b-b089ccec3876]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9856b-7e97-4825-9945-11760a21186c]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:58:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaa4d07-d59d-4f43-ad61-36355a6d9f19]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddb479f-166a-4515-827e-f7713657fcf5]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260]
Aug 01 16:58:35 user nova-compute[72184]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b, portal: 172.16.0.220,3260] successful.
Aug 01 16:58:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56cde5f3-f122-4535-a57a-2ad98a50093b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5de014-8b0f-4b93-a678-00303660431e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] <== disconnect_volume: return (257ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'flavor' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2c5491bf-16fc-4338-b9d4-711d876c20be tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:36 user nova-compute[72184]: INFO nova.compute.manager [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Unrescuing
Aug 01 16:58:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'flavor' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-b20e7938-05b1-41b2-929f-48560cdebdbb req-76b6c0d1-18a9-45b4-ba20-bdd90494b4b5 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b20e7938-05b1-41b2-929f-48560cdebdbb req-76b6c0d1-18a9-45b4-ba20-bdd90494b4b5 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b20e7938-05b1-41b2-929f-48560cdebdbb req-76b6c0d1-18a9-45b4-ba20-bdd90494b4b5 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b20e7938-05b1-41b2-929f-48560cdebdbb req-76b6c0d1-18a9-45b4-ba20-bdd90494b4b5 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-b20e7938-05b1-41b2-929f-48560cdebdbb req-76b6c0d1-18a9-45b4-ba20-bdd90494b4b5 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:37 user nova-compute[72184]: WARNING nova.compute.manager [req-b20e7938-05b1-41b2-929f-48560cdebdbb req-76b6c0d1-18a9-45b4-ba20-bdd90494b4b5 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance destroyed successfully.
Aug 01 16:58:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:40 user nova-compute[72184]: WARNING nova.compute.manager [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:40 user nova-compute[72184]: WARNING nova.compute.manager [req-3f38ad0a-1b31-43e2-95ef-3ba462414cd9 req-29c555d0-c95f-4720-bfd5-a1abd73bcaa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state rescued and task_state unrescuing.
Aug 01 16:58:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 69c7aebb-9797-4347-8f0c-ce5c175629e2 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909121.6993341, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Resumed (Lifecycle Event)
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e6becc1a-670e-468a-9bf5-941d9f164cc6 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909121.7009847, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Started (Lifecycle Event)
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-9fabc688-4b72-4f30-9e4f-f5f8f956014c req-ee818067-4efd-4f26-93eb-67ed80a71e8b service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9fabc688-4b72-4f30-9e4f-f5f8f956014c req-ee818067-4efd-4f26-93eb-67ed80a71e8b service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9fabc688-4b72-4f30-9e4f-f5f8f956014c req-ee818067-4efd-4f26-93eb-67ed80a71e8b service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9fabc688-4b72-4f30-9e4f-f5f8f956014c req-ee818067-4efd-4f26-93eb-67ed80a71e8b service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-9fabc688-4b72-4f30-9e4f-f5f8f956014c req-ee818067-4efd-4f26-93eb-67ed80a71e8b service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:42 user nova-compute[72184]: WARNING nova.compute.manager [req-9fabc688-4b72-4f30-9e4f-f5f8f956014c req-ee818067-4efd-4f26-93eb-67ed80a71e8b service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state active and task_state None.
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:43 user nova-compute[72184]: INFO nova.compute.manager [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Terminating instance
Aug 01 16:58:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-136de77e-6ede-46f5-a23b-b597082c5150 req-ca84ff6e-78a9-4a5e-a18c-1d454df80889 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-vif-unplugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-136de77e-6ede-46f5-a23b-b597082c5150 req-ca84ff6e-78a9-4a5e-a18c-1d454df80889 service nova] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-136de77e-6ede-46f5-a23b-b597082c5150 req-ca84ff6e-78a9-4a5e-a18c-1d454df80889 service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-136de77e-6ede-46f5-a23b-b597082c5150 req-ca84ff6e-78a9-4a5e-a18c-1d454df80889 service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-136de77e-6ede-46f5-a23b-b597082c5150 req-ca84ff6e-78a9-4a5e-a18c-1d454df80889 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] No waiting events found dispatching network-vif-unplugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-136de77e-6ede-46f5-a23b-b597082c5150 req-ca84ff6e-78a9-4a5e-a18c-1d454df80889 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-vif-unplugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:58:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Instance destroyed successfully.
Aug 01 16:58:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lazy-loading 'resources' on Instance uuid 7b407b54-6887-4b20-a3ae-50a2ce5777be {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-623125351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-623125351',id=5,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqBQaHRmRQCVjgHiCHshJwLFnDOChFlAONZJtpK/iL6UO2w5TfdE+orrMFJTJwYeiLFxUppypnuUzUjUtQy+Mfbt8WhDUcbIQQl9rd5QartVEXEALGbanAD3iDGMaS+WA==',key_name='tempest-keypair-1293735261',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ac23356679f461282fce02ad71f2442',ramdisk_id='',reservation_id='r-b16eyn80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-637338544',owner_user_name='tempest-ServerActionsV293TestJSON-637338544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe5c17c4d0a84d27ad28486da91673bd',uuid=7b407b54-6887-4b20-a3ae-50a2ce5777be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converting VIF {"id": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "address": "fa:16:3e:ec:c9:26", "network": {"id": "5030ced2-c418-47c2-b1f4-8858bef74fa0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1650763379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac23356679f461282fce02ad71f2442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f436652-34", "ovs_interfaceid": "0f436652-34b6-45b4-bf2b-0eaea58addd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG os_vif [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f436652-34, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:58:44 user nova-compute[72184]: INFO os_vif [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c9:26,bridge_name='br-int',has_traffic_filtering=True,id=0f436652-34b6-45b4-bf2b-0eaea58addd0,network=Network(5030ced2-c418-47c2-b1f4-8858bef74fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f436652-34')
Aug 01 16:58:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Deleting instance files /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be_del
Aug 01 16:58:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Deletion of /opt/stack/data/nova/instances/7b407b54-6887-4b20-a3ae-50a2ce5777be_del complete
Aug 01 16:58:44 user nova-compute[72184]: INFO nova.compute.manager [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 16:58:44 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:58:44 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:45 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Took 0.73 seconds to deallocate network for instance.
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-34d3f1fc-0abf-47e6-83c6-6fa083c39b06 req-b548e40a-1579-4a7b-9813-08d2525685c9 service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-vif-deleted-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-changed-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Refreshing instance network info cache due to event network-changed-fc02a82f-c678-49e6-8196-5213ef90e225. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.network.neutron [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Refreshing network info cache for port fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:45 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Deleted allocations for instance 7b407b54-6887-4b20-a3ae-50a2ce5777be
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-976e3a78-18e5-4862-82bd-69c5934b33f4 tempest-ServerActionsV293TestJSON-637338544 tempest-ServerActionsV293TestJSON-637338544-project-member] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-0b0dfbdf-c60a-402f-957a-0d32bd4d1312 req-cb6ff8f4-1e52-445f-af4a-fdabae93fb1d service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received event network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0b0dfbdf-c60a-402f-957a-0d32bd4d1312 req-cb6ff8f4-1e52-445f-af4a-fdabae93fb1d service nova] Acquiring lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0b0dfbdf-c60a-402f-957a-0d32bd4d1312 req-cb6ff8f4-1e52-445f-af4a-fdabae93fb1d service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0b0dfbdf-c60a-402f-957a-0d32bd4d1312 req-cb6ff8f4-1e52-445f-af4a-fdabae93fb1d service nova] Lock "7b407b54-6887-4b20-a3ae-50a2ce5777be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-0b0dfbdf-c60a-402f-957a-0d32bd4d1312 req-cb6ff8f4-1e52-445f-af4a-fdabae93fb1d service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] No waiting events found dispatching network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:45 user nova-compute[72184]: WARNING nova.compute.manager [req-0b0dfbdf-c60a-402f-957a-0d32bd4d1312 req-cb6ff8f4-1e52-445f-af4a-fdabae93fb1d service nova] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Received unexpected event network-vif-plugged-0f436652-34b6-45b4-bf2b-0eaea58addd0 for instance with vm_state deleted and task_state None.
Aug 01 16:58:46 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909111.0661645, 70e188c4-72bc-4842-bb3f-a9d611c38164 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:46 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] VM Stopped (Lifecycle Event)
Aug 01 16:58:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2ef4e47c-a1b7-4ac8-b54c-e373356ca91f None None] [instance: 70e188c4-72bc-4842-bb3f-a9d611c38164] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updated VIF entry in instance network info cache for port fc02a82f-c678-49e6-8196-5213ef90e225. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b615587c-2318-47db-b15e-0291738c3e52 req-20b1ff81-a265-4b28-9f3d-c3da6aa7b936 service nova] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:58:46 user nova-compute[72184]: INFO nova.compute.claims [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Claim successful on node user
Aug 01 16:58:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.274s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:58:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.policy [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '154bf9bc1d904d55a86bd739a2f65677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7490e7fdbe46cd8618b6431046108b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:58:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Creating image(s)
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk 1073741824" returned: 0 in 0.045s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:58:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Successfully created port: 1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Cannot resize image /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'migration_context' on Instance uuid d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Successfully updated port: 1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquired lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-changed-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Refreshing instance network info cache due to event network-changed-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] Acquiring lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updating instance_info_cache with network_info: [{"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Releasing lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Instance network_info: |[{"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] Acquired lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.neutron [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Refreshing network info cache for port 1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Start _get_guest_xml network_info=[{"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:58:49 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1629104860',display_name='tempest-AttachVolumeNegativeTest-server-1629104860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1629104860',id=22,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH6PQf9SxweNogMczJv9O7WRAATgt4jHmjlST4t7HkG73K0TQuFRHYm+RQaU+Z6QT5dKdSVp9TB7rpKAXCUjXGMAJicdBzQ3vZ0pD+xECaytP0vV1cFdq/tDEJS9cq4xg==',key_name='tempest-keypair-423909565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-32o8td0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=d4f11b06-6120-4515-9146-bfd02dad8f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:58:49 user nova-compute[72184]:   <uuid>d4f11b06-6120-4515-9146-bfd02dad8f12</uuid>
Aug 01 16:58:49 user nova-compute[72184]:   <name>instance-00000016</name>
Aug 01 16:58:49 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:58:49 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:58:49 user nova-compute[72184]:   <metadata>
Aug 01 16:58:49 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:58:49 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:58:49 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1629104860</nova:name>
Aug 01 16:58:49 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:58:49</nova:creationTime>
Aug 01 16:58:49 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:58:49 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:58:49 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:58:49 user nova-compute[72184]:       <nova:owner>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:user uuid="154bf9bc1d904d55a86bd739a2f65677">tempest-AttachVolumeNegativeTest-1778743204-project-member</nova:user>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:project uuid="9b7490e7fdbe46cd8618b6431046108b">tempest-AttachVolumeNegativeTest-1778743204</nova:project>
Aug 01 16:58:49 user nova-compute[72184]:       </nova:owner>
Aug 01 16:58:49 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:58:49 user nova-compute[72184]:       <nova:ports>
Aug 01 16:58:49 user nova-compute[72184]:         <nova:port uuid="1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde">
Aug 01 16:58:49 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 16:58:49 user nova-compute[72184]:         </nova:port>
Aug 01 16:58:49 user nova-compute[72184]:       </nova:ports>
Aug 01 16:58:49 user nova-compute[72184]:     </nova:instance>
Aug 01 16:58:49 user nova-compute[72184]:   </metadata>
Aug 01 16:58:49 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:58:49 user nova-compute[72184]:     <system>
Aug 01 16:58:49 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:58:49 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:58:49 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:58:49 user nova-compute[72184]:       <entry name="serial">d4f11b06-6120-4515-9146-bfd02dad8f12</entry>
Aug 01 16:58:49 user nova-compute[72184]:       <entry name="uuid">d4f11b06-6120-4515-9146-bfd02dad8f12</entry>
Aug 01 16:58:49 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:58:49 user nova-compute[72184]:     </system>
Aug 01 16:58:49 user nova-compute[72184]:   </sysinfo>
Aug 01 16:58:49 user nova-compute[72184]:   <os>
Aug 01 16:58:49 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:58:49 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:58:49 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:58:49 user nova-compute[72184]:   </os>
Aug 01 16:58:49 user nova-compute[72184]:   <features>
Aug 01 16:58:49 user nova-compute[72184]:     <acpi/>
Aug 01 16:58:49 user nova-compute[72184]:     <apic/>
Aug 01 16:58:49 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:58:49 user nova-compute[72184]:   </features>
Aug 01 16:58:49 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:58:49 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:58:49 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:58:49 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:58:49 user nova-compute[72184]:   </clock>
Aug 01 16:58:49 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:58:49 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:58:49 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:58:49 user nova-compute[72184]:   </cpu>
Aug 01 16:58:49 user nova-compute[72184]:   <devices>
Aug 01 16:58:49 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:58:49 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:58:49 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk"/>
Aug 01 16:58:49 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:58:49 user nova-compute[72184]:     </disk>
Aug 01 16:58:49 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:58:49 user nova-compute[72184]:       <mac address="fa:16:3e:53:08:e3"/>
Aug 01 16:58:49 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:58:49 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:58:49 user nova-compute[72184]:       <target dev="tap1ed94d1e-2f"/>
Aug 01 16:58:49 user nova-compute[72184]:     </interface>
Aug 01 16:58:49 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:58:49 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/console.log" append="off"/>
Aug 01 16:58:49 user nova-compute[72184]:     </serial>
Aug 01 16:58:49 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:58:49 user nova-compute[72184]:     <video>
Aug 01 16:58:49 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:58:49 user nova-compute[72184]:     </video>
Aug 01 16:58:49 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:58:49 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:58:49 user nova-compute[72184]:     </rng>
Aug 01 16:58:49 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:58:49 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:58:49 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:58:49 user nova-compute[72184]:     </memballoon>
Aug 01 16:58:49 user nova-compute[72184]:   </devices>
Aug 01 16:58:49 user nova-compute[72184]: </domain>
Aug 01 16:58:49 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1629104860',display_name='tempest-AttachVolumeNegativeTest-server-1629104860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1629104860',id=22,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH6PQf9SxweNogMczJv9O7WRAATgt4jHmjlST4t7HkG73K0TQuFRHYm+RQaU+Z6QT5dKdSVp9TB7rpKAXCUjXGMAJicdBzQ3vZ0pD+xECaytP0vV1cFdq/tDEJS9cq4xg==',key_name='tempest-keypair-423909565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-32o8td0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=d4f11b06-6120-4515-9146-bfd02dad8f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG os_vif [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ed94d1e-2f, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ed94d1e-2f, col_values=(('external_ids', {'iface-id': '1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:08:e3', 'vm-uuid': 'd4f11b06-6120-4515-9146-bfd02dad8f12'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:49 user nova-compute[72184]: INFO os_vif [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f')
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:53:08:e3, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.neutron [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updated VIF entry in instance network info cache for port 1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.network.neutron [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updating instance_info_cache with network_info: [{"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18b65826-0733-4078-897c-15fd2af0ce02 req-174127e8-5cb2-438b-ab21-ddc2f806c5c4 service nova] Releasing lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:58:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909132.9653795, d4f11b06-6120-4515-9146-bfd02dad8f12 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] VM Resumed (Lifecycle Event)
Aug 01 16:58:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-a89b821c-bcd6-43fc-8ad1-5ef4cd97ed89 req-a1a89642-51a1-4634-8472-3c123989471b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a89b821c-bcd6-43fc-8ad1-5ef4cd97ed89 req-a1a89642-51a1-4634-8472-3c123989471b service nova] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a89b821c-bcd6-43fc-8ad1-5ef4cd97ed89 req-a1a89642-51a1-4634-8472-3c123989471b service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a89b821c-bcd6-43fc-8ad1-5ef4cd97ed89 req-a1a89642-51a1-4634-8472-3c123989471b service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-a89b821c-bcd6-43fc-8ad1-5ef4cd97ed89 req-a1a89642-51a1-4634-8472-3c123989471b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] No waiting events found dispatching network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:53 user nova-compute[72184]: WARNING nova.compute.manager [req-a89b821c-bcd6-43fc-8ad1-5ef4cd97ed89 req-a1a89642-51a1-4634-8472-3c123989471b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received unexpected event network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde for instance with vm_state building and task_state spawning.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f968328-8695-48aa-82cc-0c4868162bd8 req-d35ea80a-76b0-4ece-8a03-03198de7565f service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f968328-8695-48aa-82cc-0c4868162bd8 req-d35ea80a-76b0-4ece-8a03-03198de7565f service nova] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f968328-8695-48aa-82cc-0c4868162bd8 req-d35ea80a-76b0-4ece-8a03-03198de7565f service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f968328-8695-48aa-82cc-0c4868162bd8 req-d35ea80a-76b0-4ece-8a03-03198de7565f service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f968328-8695-48aa-82cc-0c4868162bd8 req-d35ea80a-76b0-4ece-8a03-03198de7565f service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] No waiting events found dispatching network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:58:53 user nova-compute[72184]: WARNING nova.compute.manager [req-2f968328-8695-48aa-82cc-0c4868162bd8 req-d35ea80a-76b0-4ece-8a03-03198de7565f service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received unexpected event network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde for instance with vm_state building and task_state spawning.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:58:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.2025146484375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Instance spawned successfully.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909132.967111, d4f11b06-6120-4515-9146-bfd02dad8f12 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] VM Started (Lifecycle Event)
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 11dbc561-2543-456f-a729-16fc2fc42127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d4f11b06-6120-4515-9146-bfd02dad8f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:58:53 user nova-compute[72184]: INFO nova.compute.manager [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Took 6.49 seconds to build instance.
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a059378b-5f49-4a98-b632-5d35204bef4a tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.602s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:58:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:58:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:58:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:58:59 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909124.3022811, 7b407b54-6887-4b20-a3ae-50a2ce5777be => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:58:59 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] VM Stopped (Lifecycle Event)
Aug 01 16:58:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0705fbb5-1918-4f89-8ab5-6f37b79edaae None None] [instance: 7b407b54-6887-4b20-a3ae-50a2ce5777be] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:58:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:05 user nova-compute[72184]: INFO nova.compute.manager [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Terminating instance
Aug 01 16:59:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-7e412257-7415-4d8f-b60d-8a6272fc2185 req-d7308b45-2c49-4af2-9c60-3113c624bddf service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-unplugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7e412257-7415-4d8f-b60d-8a6272fc2185 req-d7308b45-2c49-4af2-9c60-3113c624bddf service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7e412257-7415-4d8f-b60d-8a6272fc2185 req-d7308b45-2c49-4af2-9c60-3113c624bddf service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7e412257-7415-4d8f-b60d-8a6272fc2185 req-d7308b45-2c49-4af2-9c60-3113c624bddf service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-7e412257-7415-4d8f-b60d-8a6272fc2185 req-d7308b45-2c49-4af2-9c60-3113c624bddf service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-unplugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:59:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-7e412257-7415-4d8f-b60d-8a6272fc2185 req-d7308b45-2c49-4af2-9c60-3113c624bddf service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-unplugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:59:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Instance destroyed successfully.
Aug 01 16:59:06 user nova-compute[72184]: DEBUG nova.objects.instance [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lazy-loading 'resources' on Instance uuid 11dbc561-2543-456f-a729-16fc2fc42127 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T16:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538405060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-538405060',id=18,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVKIz/m2GY6nX0aU9l1jb0op54aoLA1tztWu1a/QyM7+Wc0COrciTwOtHgAnoaWVje2WsOt7scIMtdBUXJa90vH8MuKTFIwAoSJdvKtaWXIW6Gl3taQhxAhl5u1CXXe+Q==',key_name='tempest-keypair-1012009554',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df99c9ee2284aee92507254f44b1d72',ramdisk_id='',reservation_id='r-momtsm0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-759872684',owner_user_name='tempest-TaggedAttachmentsTest-759872684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb14a139a3d49adb000837495669841',uuid=11dbc561-2543-456f-a729-16fc2fc42127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converting VIF {"id": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "address": "fa:16:3e:58:35:96", "network": {"id": "70722c33-73bb-4c56-8bb7-5845c482b6c1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1175722851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df99c9ee2284aee92507254f44b1d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed9cdf5-62", "ovs_interfaceid": "4ed9cdf5-62d0-4df7-a7ce-f185da297f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG os_vif [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed9cdf5-62, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:06 user nova-compute[72184]: INFO os_vif [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:96,bridge_name='br-int',has_traffic_filtering=True,id=4ed9cdf5-62d0-4df7-a7ce-f185da297f8d,network=Network(70722c33-73bb-4c56-8bb7-5845c482b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed9cdf5-62')
Aug 01 16:59:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Deleting instance files /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127_del
Aug 01 16:59:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Deletion of /opt/stack/data/nova/instances/11dbc561-2543-456f-a729-16fc2fc42127_del complete
Aug 01 16:59:06 user nova-compute[72184]: INFO nova.compute.manager [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 16:59:06 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:59:06 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:07 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Took 1.09 seconds to deallocate network for instance.
Aug 01 16:59:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-f30a917b-b63b-415b-9617-db955c024829 req-acca6279-e877-4dd6-84fe-3ff4222f0bc1 service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-deleted-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-7aa47e33-e8af-444a-b66e-90c85c0dde1e req-33cca8e4-cde6-4f74-9495-2acdd3b7df7b service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received event network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7aa47e33-e8af-444a-b66e-90c85c0dde1e req-33cca8e4-cde6-4f74-9495-2acdd3b7df7b service nova] Acquiring lock "11dbc561-2543-456f-a729-16fc2fc42127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7aa47e33-e8af-444a-b66e-90c85c0dde1e req-33cca8e4-cde6-4f74-9495-2acdd3b7df7b service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7aa47e33-e8af-444a-b66e-90c85c0dde1e req-33cca8e4-cde6-4f74-9495-2acdd3b7df7b service nova] Lock "11dbc561-2543-456f-a729-16fc2fc42127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-7aa47e33-e8af-444a-b66e-90c85c0dde1e req-33cca8e4-cde6-4f74-9495-2acdd3b7df7b service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] No waiting events found dispatching network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:59:07 user nova-compute[72184]: WARNING nova.compute.manager [req-7aa47e33-e8af-444a-b66e-90c85c0dde1e req-33cca8e4-cde6-4f74-9495-2acdd3b7df7b service nova] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Received unexpected event network-vif-plugged-4ed9cdf5-62d0-4df7-a7ce-f185da297f8d for instance with vm_state deleted and task_state None.
Aug 01 16:59:07 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:59:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:07 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Deleted allocations for instance 11dbc561-2543-456f-a729-16fc2fc42127
Aug 01 16:59:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-71b3ae25-93f3-4337-8ecf-9544145be129 tempest-TaggedAttachmentsTest-759872684 tempest-TaggedAttachmentsTest-759872684-project-member] Lock "11dbc561-2543-456f-a729-16fc2fc42127" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:21 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909146.2252166, 11dbc561-2543-456f-a729-16fc2fc42127 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:59:21 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] VM Stopped (Lifecycle Event)
Aug 01 16:59:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-af01f442-aac8-4c00-9466-417d8eb4bbd7 None None] [instance: 11dbc561-2543-456f-a729-16fc2fc42127] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:59:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-changed-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Refreshing instance network info cache due to event network-changed-d8c311e0-0221-4d18-8579-f30e351d6ad5. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] Acquiring lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] Acquired lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:59:23 user nova-compute[72184]: DEBUG nova.network.neutron [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Refreshing network info cache for port d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:59:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:24 user nova-compute[72184]: INFO nova.compute.manager [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Terminating instance
Aug 01 16:59:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:59:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.network.neutron [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updated VIF entry in instance network info cache for port d8c311e0-0221-4d18-8579-f30e351d6ad5. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.network.neutron [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-337196ac-1d0f-4ea1-9d5d-a86c33accfd0 req-0ae03108-19da-472d-bb3d-b1fe766055f9 service nova] Releasing lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:59:25 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Instance destroyed successfully.
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lazy-loading 'resources' on Instance uuid a70ead3f-68f7-4be2-acbd-b5b4f6501a54 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-842643259',display_name='tempest-ServerStableDeviceRescueTest-server-842643259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-842643259',id=7,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIohFOUjcgbCcEJVHNMMVKdtDg/iJ7UD6loeqFDRoqcofm/E/mwfo4ZcHkSNKUtSw7ZiWLoK7zIV1QA46aomYsQO7Yf5OX1J9BUKLKSkNxkKQyisbBwt6FItJj+GMp58Cg==',key_name='tempest-keypair-1152278047',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba59b45c64bc4f50babadda186b3c8ac',ramdisk_id='',reservation_id='r-vrl7515u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-245198057',owner_user_name='tempest-ServerStableDeviceRescueTest-245198057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fde93855aff4cd7b32bca4e3a56380e',uuid=a70ead3f-68f7-4be2-acbd-b5b4f6501a54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converting VIF {"id": "2d8ec797-0e9e-4016-983f-aca7420380b2", "address": "fa:16:3e:bc:88:b2", "network": {"id": "536e7e9a-a5d2-4598-81d9-74e02d04b1a0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515411185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba59b45c64bc4f50babadda186b3c8ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8ec797-0e", "ovs_interfaceid": "2d8ec797-0e9e-4016-983f-aca7420380b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG os_vif [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d8ec797-0e, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:59:25 user nova-compute[72184]: INFO os_vif [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:88:b2,bridge_name='br-int',has_traffic_filtering=True,id=2d8ec797-0e9e-4016-983f-aca7420380b2,network=Network(536e7e9a-a5d2-4598-81d9-74e02d04b1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8ec797-0e')
Aug 01 16:59:25 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Deleting instance files /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54_del
Aug 01 16:59:25 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Deletion of /opt/stack/data/nova/instances/a70ead3f-68f7-4be2-acbd-b5b4f6501a54_del complete
Aug 01 16:59:25 user nova-compute[72184]: INFO nova.compute.manager [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-unplugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] Acquiring lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] No waiting events found dispatching network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:59:25 user nova-compute[72184]: WARNING nova.compute.manager [req-b03e8ecd-eaf5-435f-a179-e023a622bd44 req-1388254d-6c5b-4575-bba6-4ea442151457 service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received unexpected event network-vif-plugged-2d8ec797-0e9e-4016-983f-aca7420380b2 for instance with vm_state active and task_state deleting.
Aug 01 16:59:26 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:26 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Took 0.75 seconds to deallocate network for instance.
Aug 01 16:59:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-127a8ffa-414c-4ad3-abec-03e9ff7e34b9 req-bd9473ee-8232-4f9f-a43f-e87f8f968b1f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Received event network-vif-deleted-2d8ec797-0e9e-4016-983f-aca7420380b2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:26 user nova-compute[72184]: INFO nova.compute.manager [req-127a8ffa-414c-4ad3-abec-03e9ff7e34b9 req-bd9473ee-8232-4f9f-a43f-e87f8f968b1f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Neutron deleted interface 2d8ec797-0e9e-4016-983f-aca7420380b2; detaching it from the instance and deleting it from the info cache
Aug 01 16:59:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-127a8ffa-414c-4ad3-abec-03e9ff7e34b9 req-bd9473ee-8232-4f9f-a43f-e87f8f968b1f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-127a8ffa-414c-4ad3-abec-03e9ff7e34b9 req-bd9473ee-8232-4f9f-a43f-e87f8f968b1f service nova] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Detach interface failed, port_id=2d8ec797-0e9e-4016-983f-aca7420380b2, reason: Instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:59:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:26 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:59:26 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:59:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:26 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Deleted allocations for instance a70ead3f-68f7-4be2-acbd-b5b4f6501a54
Aug 01 16:59:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ccc19abf-46b4-4395-aff4-3aba3edfccd7 tempest-ServerStableDeviceRescueTest-245198057 tempest-ServerStableDeviceRescueTest-245198057-project-member] Lock "a70ead3f-68f7-4be2-acbd-b5b4f6501a54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.126s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'flavor' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:34 user nova-compute[72184]: INFO nova.compute.manager [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Attaching volume 3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 to /dev/vdb
Aug 01 16:59:34 user nova-compute[72184]: DEBUG os_brick.utils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7b0f59-e823-4c0b-a7d4-8d00f9d32d65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[457f7b7e-b81b-4aa9-a55d-c51082779d2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26946c75-3883-4dfb-88cb-6318a1dea176]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6387363c-937b-4ed0-a433-2467efef0e5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:59:34 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:59:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b71c6-fbe3-4890-97d8-55468d876f35]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG os_brick.utils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:59:34 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating existing volume attachment record: 46400662-6409-4f6b-aac2-1fb9504fcd59 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:59:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:59:38 user nova-compute[72184]: INFO nova.compute.claims [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Claim successful on node user
Aug 01 16:59:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:59:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:59:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:59:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Creating image(s)
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "/opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "/opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "/opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.policy [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dc8d3f9b93c4eccb787aafafd861eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d6ef69825a4edfa90bbf9f6c4f7ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk 1073741824" returned: 0 in 0.052s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Cannot resize image /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lazy-loading 'migration_context' on Instance uuid af5bb465-0d7a-4768-b488-c7519b972afd {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Ensure instance console log exists: /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Successfully created port: d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909165.678231, a70ead3f-68f7-4be2-acbd-b5b4f6501a54 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:59:40 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] VM Stopped (Lifecycle Event)
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2e3de485-8e96-4424-8fb6-44998ca0f68a None None] [instance: a70ead3f-68f7-4be2-acbd-b5b4f6501a54] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Successfully updated port: d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "refresh_cache-af5bb465-0d7a-4768-b488-c7519b972afd" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquired lock "refresh_cache-af5bb465-0d7a-4768-b488-c7519b972afd" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-changed-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Refreshing instance network info cache due to event network-changed-d978ca04-7ca5-425a-8566-365487478a5f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] Acquiring lock "refresh_cache-af5bb465-0d7a-4768-b488-c7519b972afd" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:59:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Updating instance_info_cache with network_info: [{"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Releasing lock "refresh_cache-af5bb465-0d7a-4768-b488-c7519b972afd" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Instance network_info: |[{"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] Acquired lock "refresh_cache-af5bb465-0d7a-4768-b488-c7519b972afd" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Refreshing network info cache for port d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Start _get_guest_xml network_info=[{"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:59:41 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:59:41 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1476730704',display_name='tempest-DeleteServersTestJSON-server-1476730704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1476730704',id=23,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3d6ef69825a4edfa90bbf9f6c4f7ed1',ramdisk_id='',reservation_id='r-icxe5yce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-90383099',owner_user_name='tempest-DeleteServersTestJSON-90383099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:59:39Z,user_data=None,user_id='8dc8d3f9b93c4eccb787aafafd861eef',uuid=af5bb465-0d7a-4768-b488-c7519b972afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Converting VIF {"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lazy-loading 'pci_devices' on Instance uuid af5bb465-0d7a-4768-b488-c7519b972afd {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:59:41 user nova-compute[72184]:   <uuid>af5bb465-0d7a-4768-b488-c7519b972afd</uuid>
Aug 01 16:59:41 user nova-compute[72184]:   <name>instance-00000017</name>
Aug 01 16:59:41 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 16:59:41 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 16:59:41 user nova-compute[72184]:   <metadata>
Aug 01 16:59:41 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:59:41 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 16:59:41 user nova-compute[72184]:       <nova:name>tempest-DeleteServersTestJSON-server-1476730704</nova:name>
Aug 01 16:59:41 user nova-compute[72184]:       <nova:creationTime>2023-08-01 16:59:41</nova:creationTime>
Aug 01 16:59:41 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 16:59:41 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:59:41 user nova-compute[72184]:       </nova:flavor>
Aug 01 16:59:41 user nova-compute[72184]:       <nova:owner>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:user uuid="8dc8d3f9b93c4eccb787aafafd861eef">tempest-DeleteServersTestJSON-90383099-project-member</nova:user>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:project uuid="f3d6ef69825a4edfa90bbf9f6c4f7ed1">tempest-DeleteServersTestJSON-90383099</nova:project>
Aug 01 16:59:41 user nova-compute[72184]:       </nova:owner>
Aug 01 16:59:41 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 16:59:41 user nova-compute[72184]:       <nova:ports>
Aug 01 16:59:41 user nova-compute[72184]:         <nova:port uuid="d978ca04-7ca5-425a-8566-365487478a5f">
Aug 01 16:59:41 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 16:59:41 user nova-compute[72184]:         </nova:port>
Aug 01 16:59:41 user nova-compute[72184]:       </nova:ports>
Aug 01 16:59:41 user nova-compute[72184]:     </nova:instance>
Aug 01 16:59:41 user nova-compute[72184]:   </metadata>
Aug 01 16:59:41 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 16:59:41 user nova-compute[72184]:     <system>
Aug 01 16:59:41 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:59:41 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:59:41 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 16:59:41 user nova-compute[72184]:       <entry name="serial">af5bb465-0d7a-4768-b488-c7519b972afd</entry>
Aug 01 16:59:41 user nova-compute[72184]:       <entry name="uuid">af5bb465-0d7a-4768-b488-c7519b972afd</entry>
Aug 01 16:59:41 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:59:41 user nova-compute[72184]:     </system>
Aug 01 16:59:41 user nova-compute[72184]:   </sysinfo>
Aug 01 16:59:41 user nova-compute[72184]:   <os>
Aug 01 16:59:41 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:59:41 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 16:59:41 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 16:59:41 user nova-compute[72184]:   </os>
Aug 01 16:59:41 user nova-compute[72184]:   <features>
Aug 01 16:59:41 user nova-compute[72184]:     <acpi/>
Aug 01 16:59:41 user nova-compute[72184]:     <apic/>
Aug 01 16:59:41 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 16:59:41 user nova-compute[72184]:   </features>
Aug 01 16:59:41 user nova-compute[72184]:   <clock offset="utc">
Aug 01 16:59:41 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:59:41 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:59:41 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 16:59:41 user nova-compute[72184]:   </clock>
Aug 01 16:59:41 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 16:59:41 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 16:59:41 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:59:41 user nova-compute[72184]:   </cpu>
Aug 01 16:59:41 user nova-compute[72184]:   <devices>
Aug 01 16:59:41 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 16:59:41 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:59:41 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk"/>
Aug 01 16:59:41 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 16:59:41 user nova-compute[72184]:     </disk>
Aug 01 16:59:41 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 16:59:41 user nova-compute[72184]:       <mac address="fa:16:3e:b3:39:b8"/>
Aug 01 16:59:41 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:59:41 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 16:59:41 user nova-compute[72184]:       <target dev="tapd978ca04-7c"/>
Aug 01 16:59:41 user nova-compute[72184]:     </interface>
Aug 01 16:59:41 user nova-compute[72184]:     <serial type="pty">
Aug 01 16:59:41 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/console.log" append="off"/>
Aug 01 16:59:41 user nova-compute[72184]:     </serial>
Aug 01 16:59:41 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:59:41 user nova-compute[72184]:     <video>
Aug 01 16:59:41 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 16:59:41 user nova-compute[72184]:     </video>
Aug 01 16:59:41 user nova-compute[72184]:     <rng model="virtio">
Aug 01 16:59:41 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:59:41 user nova-compute[72184]:     </rng>
Aug 01 16:59:41 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:59:41 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 16:59:41 user nova-compute[72184]:       <stats period="10"/>
Aug 01 16:59:41 user nova-compute[72184]:     </memballoon>
Aug 01 16:59:41 user nova-compute[72184]:   </devices>
Aug 01 16:59:41 user nova-compute[72184]: </domain>
Aug 01 16:59:41 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1476730704',display_name='tempest-DeleteServersTestJSON-server-1476730704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1476730704',id=23,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3d6ef69825a4edfa90bbf9f6c4f7ed1',ramdisk_id='',reservation_id='r-icxe5yce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-90383099',owner_user_name='tempest-DeleteServersTestJSON-90383099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:59:39Z,user_data=None,user_id='8dc8d3f9b93c4eccb787aafafd861eef',uuid=af5bb465-0d7a-4768-b488-c7519b972afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Converting VIF {"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG os_vif [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd978ca04-7c, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd978ca04-7c, col_values=(('external_ids', {'iface-id': 'd978ca04-7ca5-425a-8566-365487478a5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:39:b8', 'vm-uuid': 'af5bb465-0d7a-4768-b488-c7519b972afd'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:41 user nova-compute[72184]: INFO os_vif [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c')
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] No VIF found with MAC fa:16:3e:b3:39:b8, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Updated VIF entry in instance network info cache for port d978ca04-7ca5-425a-8566-365487478a5f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Updating instance_info_cache with network_info: [{"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-94943906-888d-4fe5-b893-4f199a5e1d8e req-380eb3af-2b33-4899-a088-ae5ebedf634b service nova] Releasing lock "refresh_cache-af5bb465-0d7a-4768-b488-c7519b972afd" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:59:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:59:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:59:42 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[911b9c47-1b52-471a-abc9-1c2920e41960]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:59:42 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc82f9-0527-49c9-97e9-4b8550458573]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9] added
Aug 01 16:59:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b84950e-8299-4177-a809-c752baeb422a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd5dde-f737-4b8d-9c46-6e5aa98f76b4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdFOAswZ {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdFOAswZ" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc99a908-a9d7-4aa6-a820-e84aa2e3b06b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdFOAswZ'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdca64f-c02c-479b-a6d5-89ee68759fb2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3cece2-c1ed-4117-860d-5db134e7f922]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:59:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:59:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb187bc-82e4-429e-aa77-6eadd52e9112]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]
Aug 01 16:59:42 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.
Aug 01 16:59:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65cfc1d-0ec3-4ce0-ab4e-b891036d0318]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32a8b8-8dfb-4d8e-9aed-d082f4f46629]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:59:42 user nova-compute[72184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 16:59:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 16:59:42 user nova-compute[72184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 16:59:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b82ddc-0742-455d-9985-16b03f26c5d1]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-52ce3747-5554-484a-af94-f3a431657d16 req-a2c14a4c-b67b-44c8-b735-8016a571320b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-52ce3747-5554-484a-af94-f3a431657d16 req-a2c14a4c-b67b-44c8-b735-8016a571320b service nova] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-52ce3747-5554-484a-af94-f3a431657d16 req-a2c14a4c-b67b-44c8-b735-8016a571320b service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-52ce3747-5554-484a-af94-f3a431657d16 req-a2c14a4c-b67b-44c8-b735-8016a571320b service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-52ce3747-5554-484a-af94-f3a431657d16 req-a2c14a4c-b67b-44c8-b735-8016a571320b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] No waiting events found dispatching network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:59:42 user nova-compute[72184]: WARNING nova.compute.manager [req-52ce3747-5554-484a-af94-f3a431657d16 req-a2c14a4c-b67b-44c8-b735-8016a571320b service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received unexpected event network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f for instance with vm_state building and task_state spawning.
Aug 01 16:59:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26131333063336337', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131333063336337', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'flavor' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:59:43 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:59:43 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 16:59:43 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:59:43 user nova-compute[72184]:   <serial>3ef66bd3-ecae-45f2-84f2-99e3ceedbea9</serial>
Aug 01 16:59:43 user nova-compute[72184]: </disk>
Aug 01 16:59:43 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:59:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:59:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:59:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No VIF found with MAC fa:16:3e:6e:9c:91, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:59:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-381629cb-7b8d-49e7-b39c-2898f95ff19e tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.821s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-0eb452b6-cb7c-4177-937e-ae6908442dff req-a12333d4-17e0-487f-a576-f98f53f96a2c service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0eb452b6-cb7c-4177-937e-ae6908442dff req-a12333d4-17e0-487f-a576-f98f53f96a2c service nova] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0eb452b6-cb7c-4177-937e-ae6908442dff req-a12333d4-17e0-487f-a576-f98f53f96a2c service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0eb452b6-cb7c-4177-937e-ae6908442dff req-a12333d4-17e0-487f-a576-f98f53f96a2c service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-0eb452b6-cb7c-4177-937e-ae6908442dff req-a12333d4-17e0-487f-a576-f98f53f96a2c service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] No waiting events found dispatching network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:59:45 user nova-compute[72184]: WARNING nova.compute.manager [req-0eb452b6-cb7c-4177-937e-ae6908442dff req-a12333d4-17e0-487f-a576-f98f53f96a2c service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received unexpected event network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f for instance with vm_state building and task_state spawning.
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909185.0882013, af5bb465-0d7a-4768-b488-c7519b972afd => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] VM Resumed (Lifecycle Event)
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Instance spawned successfully.
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909185.0891895, af5bb465-0d7a-4768-b488-c7519b972afd => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] VM Started (Lifecycle Event)
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 01 16:59:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:59:45 user nova-compute[72184]: INFO nova.compute.manager [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Took 6.94 seconds to build instance.
Aug 01 16:59:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a92ad281-fc81-4c38-a2fd-ed0a72a63f00 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.076s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:47 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:59:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:59:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=25.307498931884766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 202a214d-94fc-4748-a403-abdbc75a4157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d4f11b06-6120-4515-9146-bfd02dad8f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance af5bb465-0d7a-4768-b488-c7519b972afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:59:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:59:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:59:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 202a214d-94fc-4748-a403-abdbc75a4157 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updating instance_info_cache with network_info: [{"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-202a214d-94fc-4748-a403-abdbc75a4157" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:59:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing instance network info cache due to event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updated VIF entry in instance network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e70e2334-bea8-4554-a9a1-33cb8b867e36 req-f8f4aeea-44fa-4fed-b3c7-d5324f6550dc service nova] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:59:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing instance network info cache due to event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updated VIF entry in instance network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:59:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7cfaed9-2cf3-4395-a87d-418c3d8a9da7 req-e432001a-27be-4f33-9c39-26f2b9fd7a16 service nova] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:03 user nova-compute[72184]: INFO nova.compute.manager [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Rebooting instance
Aug 01 17:00:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:00:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd92f60b-e2ec-42ba-954d-d0a3912b2046 req-24af2db5-55a0-4e74-bdc2-7a525accc8e2 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-unplugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd92f60b-e2ec-42ba-954d-d0a3912b2046 req-24af2db5-55a0-4e74-bdc2-7a525accc8e2 service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd92f60b-e2ec-42ba-954d-d0a3912b2046 req-24af2db5-55a0-4e74-bdc2-7a525accc8e2 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd92f60b-e2ec-42ba-954d-d0a3912b2046 req-24af2db5-55a0-4e74-bdc2-7a525accc8e2 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd92f60b-e2ec-42ba-954d-d0a3912b2046 req-24af2db5-55a0-4e74-bdc2-7a525accc8e2 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-unplugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:05 user nova-compute[72184]: WARNING nova.compute.manager [req-bd92f60b-e2ec-42ba-954d-d0a3912b2046 req-24af2db5-55a0-4e74-bdc2-7a525accc8e2 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-unplugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 17:00:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance destroyed successfully.
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'resources' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612266205',display_name='tempest-TestMinimumBasicScenario-server-612266205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612266205',id=21,image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5nPvYMhC5rR/sBonwGmp5lxGTG4O5MHsd6ezhFpv87E9ob3ikbZTyQpqjLXBG5Zs3u83C8VYktVbBI/H7Or9/KMDAmOrEZfqKTo2rhRSesYE8upRrvHg05hc/XfhVgWA==',key_name='tempest-TestMinimumBasicScenario-1780885707',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-6179r134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:00:04Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=64db4084-3f8d-4f1a-87f7-99a86671fdd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d9c3dfc-14, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:05 user nova-compute[72184]: INFO os_vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14')
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6bcbe8-33dc-4f27-b5d1-31d2ea2ec501]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e70fb-7838-4ab2-a71e-0b64941360b2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:05 user nova-compute[72184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:05 user nova-compute[72184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30184de710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd194f44-e7b9-4f1e-9c18-41d7c1cf514b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be64c9-970c-4263-bc3a-343c5e8a1def]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73fac7-644b-475b-bec7-9c688a484a04]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f560b-0407-4b5f-bd67-c2bcb5c8f07b]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[41753b09-181f-4b20-9a8d-067671a4eda6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8509ba49-8926-45b0-854d-8a888e1a4283]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]
Aug 01 17:00:05 user nova-compute[72184]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8257592-91f7-4e6c-873d-c203619be9f0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== disconnect_volume: return (300ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Start _get_guest_xml network_info=[{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e826beb3-bd81-44a6-91a5-d7ecf5c60160,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'e826beb3-bd81-44a6-91a5-d7ecf5c60160'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '46400662-6409-4f6b-aac2-1fb9504fcd59', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '64db4084-3f8d-4f1a-87f7-99a86671fdd1', 'attached_at': '', 'detached_at': '', 'volume_id': '3ef66bd3-ecae-45f2-84f2-99e3ceedbea9', 'serial': '3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:00:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e826beb3-bd81-44a6-91a5-d7ecf5c60160,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:05 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb66b43-7e7f-4f14-aa69-b68ef48471e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:00:05 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be49a667-0202-425d-a594-9911567f0d37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9] added
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0602d974-588b-4f3b-973a-81c2400f0bb0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f43fd9-00d0-4e5e-90e2-5b2c275e47f0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdFOAswZ {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdFOAswZ" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fae0bd-42d7-413c-8668-7e049e389bef]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdFOAswZ'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaee593-c26c-423e-a7b4-d93112854db0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[601d4818-c9e6-4f9f-83b6-e9ca6ccffade]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04efbd45-1f31-4b5f-bec1-d373348dd485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]
Aug 01 17:00:05 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab0ab31-be33-47c8-b545-e3afe516b43e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e10794-309b-418a-bde3-907e81e3eb6e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:05 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:05 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:00:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd8247a-571f-47b3-b552-567fb20989ec]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:06 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:00:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:00:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26131333063336337', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131333063336337', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612266205',display_name='tempest-TestMinimumBasicScenario-server-612266205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612266205',id=21,image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5nPvYMhC5rR/sBonwGmp5lxGTG4O5MHsd6ezhFpv87E9ob3ikbZTyQpqjLXBG5Zs3u83C8VYktVbBI/H7Or9/KMDAmOrEZfqKTo2rhRSesYE8upRrvHg05hc/XfhVgWA==',key_name='tempest-TestMinimumBasicScenario-1780885707',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-6179r134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:00:04Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=64db4084-3f8d-4f1a-87f7-99a86671fdd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'pci_devices' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:00:07 user nova-compute[72184]:   <uuid>64db4084-3f8d-4f1a-87f7-99a86671fdd1</uuid>
Aug 01 17:00:07 user nova-compute[72184]:   <name>instance-00000015</name>
Aug 01 17:00:07 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:00:07 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:00:07 user nova-compute[72184]:   <metadata>
Aug 01 17:00:07 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:00:07 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:00:07 user nova-compute[72184]:       <nova:name>tempest-TestMinimumBasicScenario-server-612266205</nova:name>
Aug 01 17:00:07 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:00:05</nova:creationTime>
Aug 01 17:00:07 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:00:07 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:00:07 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:00:07 user nova-compute[72184]:       <nova:owner>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:user uuid="9ae2243c375e4f23a9bb9d3abaab63cc">tempest-TestMinimumBasicScenario-582463682-project-member</nova:user>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:project uuid="d793a9d1897f42be86ed38b4dff4f977">tempest-TestMinimumBasicScenario-582463682</nova:project>
Aug 01 17:00:07 user nova-compute[72184]:       </nova:owner>
Aug 01 17:00:07 user nova-compute[72184]:       <nova:root type="image" uuid="e826beb3-bd81-44a6-91a5-d7ecf5c60160"/>
Aug 01 17:00:07 user nova-compute[72184]:       <nova:ports>
Aug 01 17:00:07 user nova-compute[72184]:         <nova:port uuid="3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8">
Aug 01 17:00:07 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 17:00:07 user nova-compute[72184]:         </nova:port>
Aug 01 17:00:07 user nova-compute[72184]:       </nova:ports>
Aug 01 17:00:07 user nova-compute[72184]:     </nova:instance>
Aug 01 17:00:07 user nova-compute[72184]:   </metadata>
Aug 01 17:00:07 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:00:07 user nova-compute[72184]:     <system>
Aug 01 17:00:07 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:00:07 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:00:07 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:00:07 user nova-compute[72184]:       <entry name="serial">64db4084-3f8d-4f1a-87f7-99a86671fdd1</entry>
Aug 01 17:00:07 user nova-compute[72184]:       <entry name="uuid">64db4084-3f8d-4f1a-87f7-99a86671fdd1</entry>
Aug 01 17:00:07 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:00:07 user nova-compute[72184]:     </system>
Aug 01 17:00:07 user nova-compute[72184]:   </sysinfo>
Aug 01 17:00:07 user nova-compute[72184]:   <os>
Aug 01 17:00:07 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:00:07 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:00:07 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:00:07 user nova-compute[72184]:   </os>
Aug 01 17:00:07 user nova-compute[72184]:   <features>
Aug 01 17:00:07 user nova-compute[72184]:     <acpi/>
Aug 01 17:00:07 user nova-compute[72184]:     <apic/>
Aug 01 17:00:07 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:00:07 user nova-compute[72184]:   </features>
Aug 01 17:00:07 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:00:07 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:00:07 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:00:07 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:00:07 user nova-compute[72184]:   </clock>
Aug 01 17:00:07 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:00:07 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:00:07 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:00:07 user nova-compute[72184]:   </cpu>
Aug 01 17:00:07 user nova-compute[72184]:   <devices>
Aug 01 17:00:07 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:00:07 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:00:07 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk"/>
Aug 01 17:00:07 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:00:07 user nova-compute[72184]:     </disk>
Aug 01 17:00:07 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:00:07 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:00:07 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 17:00:07 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:00:07 user nova-compute[72184]:       <serial>3ef66bd3-ecae-45f2-84f2-99e3ceedbea9</serial>
Aug 01 17:00:07 user nova-compute[72184]:     </disk>
Aug 01 17:00:07 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:00:07 user nova-compute[72184]:       <mac address="fa:16:3e:6e:9c:91"/>
Aug 01 17:00:07 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:00:07 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:00:07 user nova-compute[72184]:       <target dev="tap3d9c3dfc-14"/>
Aug 01 17:00:07 user nova-compute[72184]:     </interface>
Aug 01 17:00:07 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:00:07 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/console.log" append="off"/>
Aug 01 17:00:07 user nova-compute[72184]:     </serial>
Aug 01 17:00:07 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:00:07 user nova-compute[72184]:     <video>
Aug 01 17:00:07 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:00:07 user nova-compute[72184]:     </video>
Aug 01 17:00:07 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:00:07 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:00:07 user nova-compute[72184]:     </rng>
Aug 01 17:00:07 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:00:07 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:00:07 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:00:07 user nova-compute[72184]:     </memballoon>
Aug 01 17:00:07 user nova-compute[72184]:   </devices>
Aug 01 17:00:07 user nova-compute[72184]: </domain>
Aug 01 17:00:07 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-f3ff9a74-077d-47db-b02e-f23a781f4d33 req-7ad878be-7501-4285-8a93-d3c2261bfd6a service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3ff9a74-077d-47db-b02e-f23a781f4d33 req-7ad878be-7501-4285-8a93-d3c2261bfd6a service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3ff9a74-077d-47db-b02e-f23a781f4d33 req-7ad878be-7501-4285-8a93-d3c2261bfd6a service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3ff9a74-077d-47db-b02e-f23a781f4d33 req-7ad878be-7501-4285-8a93-d3c2261bfd6a service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-f3ff9a74-077d-47db-b02e-f23a781f4d33 req-7ad878be-7501-4285-8a93-d3c2261bfd6a service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:07 user nova-compute[72184]: WARNING nova.compute.manager [req-f3ff9a74-077d-47db-b02e-f23a781f4d33 req-7ad878be-7501-4285-8a93-d3c2261bfd6a service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Cannot resize image /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'migration_context' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612266205',display_name='tempest-TestMinimumBasicScenario-server-612266205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612266205',id=21,image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5nPvYMhC5rR/sBonwGmp5lxGTG4O5MHsd6ezhFpv87E9ob3ikbZTyQpqjLXBG5Zs3u83C8VYktVbBI/H7Or9/KMDAmOrEZfqKTo2rhRSesYE8upRrvHg05hc/XfhVgWA==',key_name='tempest-TestMinimumBasicScenario-1780885707',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-6179r134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:04Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=64db4084-3f8d-4f1a-87f7-99a86671fdd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG os_vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d9c3dfc-14, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d9c3dfc-14, col_values=(('external_ids', {'iface-id': '3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:9c:91', 'vm-uuid': '64db4084-3f8d-4f1a-87f7-99a86671fdd1'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:00:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:07 user nova-compute[72184]: INFO os_vif [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14')
Aug 01 17:00:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-83474f84-31f4-4ab2-91cb-daa9d87eb17c req-3ac32273-bdc3-487e-ac71-601a25080af1 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-83474f84-31f4-4ab2-91cb-daa9d87eb17c req-3ac32273-bdc3-487e-ac71-601a25080af1 service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-83474f84-31f4-4ab2-91cb-daa9d87eb17c req-3ac32273-bdc3-487e-ac71-601a25080af1 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-83474f84-31f4-4ab2-91cb-daa9d87eb17c req-3ac32273-bdc3-487e-ac71-601a25080af1 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-83474f84-31f4-4ab2-91cb-daa9d87eb17c req-3ac32273-bdc3-487e-ac71-601a25080af1 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:09 user nova-compute[72184]: WARNING nova.compute.manager [req-83474f84-31f4-4ab2-91cb-daa9d87eb17c req-3ac32273-bdc3-487e-ac71-601a25080af1 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 17:00:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 64db4084-3f8d-4f1a-87f7-99a86671fdd1 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909211.1906853, 64db4084-3f8d-4f1a-87f7-99a86671fdd1 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] VM Resumed (Lifecycle Event)
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:00:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance rebooted successfully.
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:00:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909211.1914687, 64db4084-3f8d-4f1a-87f7-99a86671fdd1 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:11 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] VM Started (Lifecycle Event)
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ba9ddf4-3d85-4681-9b66-5bdbb216d1af tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.891s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-dc3a22a3-0510-46a8-9f01-9b4a0ca8a3e1 req-0f381c01-194c-4400-b6bf-63de901dbcc9 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dc3a22a3-0510-46a8-9f01-9b4a0ca8a3e1 req-0f381c01-194c-4400-b6bf-63de901dbcc9 service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dc3a22a3-0510-46a8-9f01-9b4a0ca8a3e1 req-0f381c01-194c-4400-b6bf-63de901dbcc9 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dc3a22a3-0510-46a8-9f01-9b4a0ca8a3e1 req-0f381c01-194c-4400-b6bf-63de901dbcc9 service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-dc3a22a3-0510-46a8-9f01-9b4a0ca8a3e1 req-0f381c01-194c-4400-b6bf-63de901dbcc9 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:11 user nova-compute[72184]: WARNING nova.compute.manager [req-dc3a22a3-0510-46a8-9f01-9b4a0ca8a3e1 req-0f381c01-194c-4400-b6bf-63de901dbcc9 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state active and task_state None.
Aug 01 17:00:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:00:27 user nova-compute[72184]: INFO nova.compute.claims [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Claim successful on node user
Aug 01 17:00:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:00:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.policy [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e33dc89b5744c2ad3c0d86f759c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a62e50ced845abbadbe12339265fdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:00:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Creating image(s)
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk 1073741824" returned: 0 in 0.071s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Cannot resize image /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'migration_context' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Ensure instance console log exists: /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Successfully created port: e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:29 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:00:29 user nova-compute[72184]: INFO nova.compute.claims [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Claim successful on node user
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Successfully updated port: e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing instance network info cache due to event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:00:30 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.policy [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9ae86640754099bb01c48a6807075f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13772bce6fa482189f819cb065170b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:00:30 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Creating image(s)
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance network_info: |[{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.neutron [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Start _get_guest_xml network_info=[{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:00:30 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:30 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-461366033',display_name='tempest-ServerRescueNegativeTestJSON-server-461366033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-461366033',id=24,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP+bS68qWQCoGZnJjxF1jc58ptndhJiEmnwylfKG9P48v8l3rYgjYPJ1jEFvOMPHwVFjb5aOT+5fNYfzwD56nXkiweV3qOUb8Xwz5GX5QsXqzSaIJRLyGtlCqA+ledbvA==',key_name='tempest-keypair-1369140919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-uyzjywnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=90809a35-7659-492d-a605-e3b40e161bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'pci_devices' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.195s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:00:30 user nova-compute[72184]:   <uuid>90809a35-7659-492d-a605-e3b40e161bbf</uuid>
Aug 01 17:00:30 user nova-compute[72184]:   <name>instance-00000018</name>
Aug 01 17:00:30 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:00:30 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:00:30 user nova-compute[72184]:   <metadata>
Aug 01 17:00:30 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:00:30 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:00:30 user nova-compute[72184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-461366033</nova:name>
Aug 01 17:00:30 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:00:30</nova:creationTime>
Aug 01 17:00:30 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:00:30 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:00:30 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:00:30 user nova-compute[72184]:       <nova:owner>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:user uuid="b0e33dc89b5744c2ad3c0d86f759c9c3">tempest-ServerRescueNegativeTestJSON-353659352-project-member</nova:user>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:project uuid="e0a62e50ced845abbadbe12339265fdc">tempest-ServerRescueNegativeTestJSON-353659352</nova:project>
Aug 01 17:00:30 user nova-compute[72184]:       </nova:owner>
Aug 01 17:00:30 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:00:30 user nova-compute[72184]:       <nova:ports>
Aug 01 17:00:30 user nova-compute[72184]:         <nova:port uuid="e026812f-e506-4c8f-b5ac-58f30b5c82b4">
Aug 01 17:00:30 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 17:00:30 user nova-compute[72184]:         </nova:port>
Aug 01 17:00:30 user nova-compute[72184]:       </nova:ports>
Aug 01 17:00:30 user nova-compute[72184]:     </nova:instance>
Aug 01 17:00:30 user nova-compute[72184]:   </metadata>
Aug 01 17:00:30 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:00:30 user nova-compute[72184]:     <system>
Aug 01 17:00:30 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:00:30 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:00:30 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:00:30 user nova-compute[72184]:       <entry name="serial">90809a35-7659-492d-a605-e3b40e161bbf</entry>
Aug 01 17:00:30 user nova-compute[72184]:       <entry name="uuid">90809a35-7659-492d-a605-e3b40e161bbf</entry>
Aug 01 17:00:30 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:00:30 user nova-compute[72184]:     </system>
Aug 01 17:00:30 user nova-compute[72184]:   </sysinfo>
Aug 01 17:00:30 user nova-compute[72184]:   <os>
Aug 01 17:00:30 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:00:30 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:00:30 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:00:30 user nova-compute[72184]:   </os>
Aug 01 17:00:30 user nova-compute[72184]:   <features>
Aug 01 17:00:30 user nova-compute[72184]:     <acpi/>
Aug 01 17:00:30 user nova-compute[72184]:     <apic/>
Aug 01 17:00:30 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:00:30 user nova-compute[72184]:   </features>
Aug 01 17:00:30 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:00:30 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:00:30 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:00:30 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:00:30 user nova-compute[72184]:   </clock>
Aug 01 17:00:30 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:00:30 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:00:30 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:00:30 user nova-compute[72184]:   </cpu>
Aug 01 17:00:30 user nova-compute[72184]:   <devices>
Aug 01 17:00:30 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:00:30 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:00:30 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk"/>
Aug 01 17:00:30 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:00:30 user nova-compute[72184]:     </disk>
Aug 01 17:00:30 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:00:30 user nova-compute[72184]:       <mac address="fa:16:3e:91:d0:8d"/>
Aug 01 17:00:30 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:00:30 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:00:30 user nova-compute[72184]:       <target dev="tape026812f-e5"/>
Aug 01 17:00:30 user nova-compute[72184]:     </interface>
Aug 01 17:00:30 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:00:30 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/console.log" append="off"/>
Aug 01 17:00:30 user nova-compute[72184]:     </serial>
Aug 01 17:00:30 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:00:30 user nova-compute[72184]:     <video>
Aug 01 17:00:30 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:00:30 user nova-compute[72184]:     </video>
Aug 01 17:00:30 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:00:30 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:00:30 user nova-compute[72184]:     </rng>
Aug 01 17:00:30 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:00:30 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:00:30 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:00:30 user nova-compute[72184]:     </memballoon>
Aug 01 17:00:30 user nova-compute[72184]:   </devices>
Aug 01 17:00:30 user nova-compute[72184]: </domain>
Aug 01 17:00:30 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-461366033',display_name='tempest-ServerRescueNegativeTestJSON-server-461366033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-461366033',id=24,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP+bS68qWQCoGZnJjxF1jc58ptndhJiEmnwylfKG9P48v8l3rYgjYPJ1jEFvOMPHwVFjb5aOT+5fNYfzwD56nXkiweV3qOUb8Xwz5GX5QsXqzSaIJRLyGtlCqA+ledbvA==',key_name='tempest-keypair-1369140919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-uyzjywnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=90809a35-7659-492d-a605-e3b40e161bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG os_vif [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk 1073741824" returned: 0 in 0.073s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape026812f-e5, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape026812f-e5, col_values=(('external_ids', {'iface-id': 'e026812f-e506-4c8f-b5ac-58f30b5c82b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:d0:8d', 'vm-uuid': '90809a35-7659-492d-a605-e3b40e161bbf'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:00:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:30 user nova-compute[72184]: INFO os_vif [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5')
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.162s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Successfully created port: a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:91:d0:8d, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Cannot resize image /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'migration_context' on Instance uuid 1ebe63cb-0db0-4cbf-b58b-71d07905c37d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Ensure instance console log exists: /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updated VIF entry in instance network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ec100afd-7357-40c4-bff9-a9bf026ce8f0 req-091119e4-4801-4a6b-84c3-98e64ff18f4c service nova] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Successfully updated port: a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-1ebe63cb-0db0-4cbf-b58b-71d07905c37d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-1ebe63cb-0db0-4cbf-b58b-71d07905c37d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-changed-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Refreshing instance network info cache due to event network-changed-a46cd6b9-962b-4a46-8812-3988e710a000. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] Acquiring lock "refresh_cache-1ebe63cb-0db0-4cbf-b58b-71d07905c37d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Updating instance_info_cache with network_info: [{"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-1ebe63cb-0db0-4cbf-b58b-71d07905c37d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Instance network_info: |[{"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] Acquired lock "refresh_cache-1ebe63cb-0db0-4cbf-b58b-71d07905c37d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Refreshing network info cache for port a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Start _get_guest_xml network_info=[{"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:00:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-966088639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-966088639',id=25,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-5bnj5r4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:30Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=1ebe63cb-0db0-4cbf-b58b-71d07905c37d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ebe63cb-0db0-4cbf-b58b-71d07905c37d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:00:32 user nova-compute[72184]:   <uuid>1ebe63cb-0db0-4cbf-b58b-71d07905c37d</uuid>
Aug 01 17:00:32 user nova-compute[72184]:   <name>instance-00000019</name>
Aug 01 17:00:32 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:00:32 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:00:32 user nova-compute[72184]:   <metadata>
Aug 01 17:00:32 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:00:32 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:00:32 user nova-compute[72184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-966088639</nova:name>
Aug 01 17:00:32 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:00:32</nova:creationTime>
Aug 01 17:00:32 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:00:32 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:00:32 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:00:32 user nova-compute[72184]:       <nova:owner>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:user uuid="1b9ae86640754099bb01c48a6807075f">tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member</nova:user>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:project uuid="b13772bce6fa482189f819cb065170b3">tempest-ServerBootFromVolumeStableRescueTest-388641611</nova:project>
Aug 01 17:00:32 user nova-compute[72184]:       </nova:owner>
Aug 01 17:00:32 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:00:32 user nova-compute[72184]:       <nova:ports>
Aug 01 17:00:32 user nova-compute[72184]:         <nova:port uuid="a46cd6b9-962b-4a46-8812-3988e710a000">
Aug 01 17:00:32 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 17:00:32 user nova-compute[72184]:         </nova:port>
Aug 01 17:00:32 user nova-compute[72184]:       </nova:ports>
Aug 01 17:00:32 user nova-compute[72184]:     </nova:instance>
Aug 01 17:00:32 user nova-compute[72184]:   </metadata>
Aug 01 17:00:32 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:00:32 user nova-compute[72184]:     <system>
Aug 01 17:00:32 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:00:32 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:00:32 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:00:32 user nova-compute[72184]:       <entry name="serial">1ebe63cb-0db0-4cbf-b58b-71d07905c37d</entry>
Aug 01 17:00:32 user nova-compute[72184]:       <entry name="uuid">1ebe63cb-0db0-4cbf-b58b-71d07905c37d</entry>
Aug 01 17:00:32 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:00:32 user nova-compute[72184]:     </system>
Aug 01 17:00:32 user nova-compute[72184]:   </sysinfo>
Aug 01 17:00:32 user nova-compute[72184]:   <os>
Aug 01 17:00:32 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:00:32 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:00:32 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:00:32 user nova-compute[72184]:   </os>
Aug 01 17:00:32 user nova-compute[72184]:   <features>
Aug 01 17:00:32 user nova-compute[72184]:     <acpi/>
Aug 01 17:00:32 user nova-compute[72184]:     <apic/>
Aug 01 17:00:32 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:00:32 user nova-compute[72184]:   </features>
Aug 01 17:00:32 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:00:32 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:00:32 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:00:32 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:00:32 user nova-compute[72184]:   </clock>
Aug 01 17:00:32 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:00:32 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:00:32 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:00:32 user nova-compute[72184]:   </cpu>
Aug 01 17:00:32 user nova-compute[72184]:   <devices>
Aug 01 17:00:32 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:00:32 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:00:32 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk"/>
Aug 01 17:00:32 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:00:32 user nova-compute[72184]:     </disk>
Aug 01 17:00:32 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:00:32 user nova-compute[72184]:       <mac address="fa:16:3e:5a:5b:91"/>
Aug 01 17:00:32 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:00:32 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:00:32 user nova-compute[72184]:       <target dev="tapa46cd6b9-96"/>
Aug 01 17:00:32 user nova-compute[72184]:     </interface>
Aug 01 17:00:32 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:00:32 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/console.log" append="off"/>
Aug 01 17:00:32 user nova-compute[72184]:     </serial>
Aug 01 17:00:32 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:00:32 user nova-compute[72184]:     <video>
Aug 01 17:00:32 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:00:32 user nova-compute[72184]:     </video>
Aug 01 17:00:32 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:00:32 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:00:32 user nova-compute[72184]:     </rng>
Aug 01 17:00:32 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:00:32 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:00:32 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:00:32 user nova-compute[72184]:     </memballoon>
Aug 01 17:00:32 user nova-compute[72184]:   </devices>
Aug 01 17:00:32 user nova-compute[72184]: </domain>
Aug 01 17:00:32 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-966088639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-966088639',id=25,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-5bnj5r4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:30Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=1ebe63cb-0db0-4cbf-b58b-71d07905c37d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG os_vif [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa46cd6b9-96, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa46cd6b9-96, col_values=(('external_ids', {'iface-id': 'a46cd6b9-962b-4a46-8812-3988e710a000', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:5b:91', 'vm-uuid': '1ebe63cb-0db0-4cbf-b58b-71d07905c37d'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:32 user nova-compute[72184]: INFO os_vif [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96')
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No VIF found with MAC fa:16:3e:5a:5b:91, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:33 user nova-compute[72184]: DEBUG nova.network.neutron [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Updated VIF entry in instance network info cache for port a46cd6b9-962b-4a46-8812-3988e710a000. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:00:33 user nova-compute[72184]: DEBUG nova.network.neutron [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Updating instance_info_cache with network_info: [{"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a029926e-4ca4-4183-bf73-57598402874a req-63a2b468-cfe4-43e9-91a9-b92127546d4e service nova] Releasing lock "refresh_cache-1ebe63cb-0db0-4cbf-b58b-71d07905c37d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:34 user nova-compute[72184]: WARNING nova.compute.manager [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state building and task_state spawning.
Aug 01 17:00:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:34 user nova-compute[72184]: WARNING nova.compute.manager [req-db38baaa-9e33-4d44-90d8-65c841fe12a7 req-40cd68f0-5a90-480f-a6aa-f73372f6a93a service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state building and task_state spawning.
Aug 01 17:00:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-92826497-470e-4d7f-b25a-d24f9d67d7e0 req-5890ae37-4df7-4de0-88d6-463754c658dc service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-92826497-470e-4d7f-b25a-d24f9d67d7e0 req-5890ae37-4df7-4de0-88d6-463754c658dc service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-92826497-470e-4d7f-b25a-d24f9d67d7e0 req-5890ae37-4df7-4de0-88d6-463754c658dc service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-92826497-470e-4d7f-b25a-d24f9d67d7e0 req-5890ae37-4df7-4de0-88d6-463754c658dc service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-92826497-470e-4d7f-b25a-d24f9d67d7e0 req-5890ae37-4df7-4de0-88d6-463754c658dc service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:34 user nova-compute[72184]: WARNING nova.compute.manager [req-92826497-470e-4d7f-b25a-d24f9d67d7e0 req-5890ae37-4df7-4de0-88d6-463754c658dc service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received unexpected event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with vm_state building and task_state spawning.
Aug 01 17:00:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909236.3362844, 90809a35-7659-492d-a605-e3b40e161bbf => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Resumed (Lifecycle Event)
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance spawned successfully.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909236.339148, 90809a35-7659-492d-a605-e3b40e161bbf => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Started (Lifecycle Event)
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Took 8.63 seconds to spawn the instance on the hypervisor.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Took 9.56 seconds to build instance.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8a72c364-3eb8-4cda-b987-ffc0cf79a13d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.674s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-3bc2277d-1c64-4991-8651-e6736771b795 req-2ea973cb-2093-4666-a579-2659416dfd8a service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3bc2277d-1c64-4991-8651-e6736771b795 req-2ea973cb-2093-4666-a579-2659416dfd8a service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3bc2277d-1c64-4991-8651-e6736771b795 req-2ea973cb-2093-4666-a579-2659416dfd8a service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3bc2277d-1c64-4991-8651-e6736771b795 req-2ea973cb-2093-4666-a579-2659416dfd8a service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-3bc2277d-1c64-4991-8651-e6736771b795 req-2ea973cb-2093-4666-a579-2659416dfd8a service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:36 user nova-compute[72184]: WARNING nova.compute.manager [req-3bc2277d-1c64-4991-8651-e6736771b795 req-2ea973cb-2093-4666-a579-2659416dfd8a service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received unexpected event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with vm_state building and task_state spawning.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909236.902703, 1ebe63cb-0db0-4cbf-b58b-71d07905c37d => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] VM Resumed (Lifecycle Event)
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Instance spawned successfully.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:00:36 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909236.917936, 1ebe63cb-0db0-4cbf-b58b-71d07905c37d => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] VM Started (Lifecycle Event)
Aug 01 17:00:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:00:37 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:00:37 user nova-compute[72184]: INFO nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 01 17:00:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:37 user nova-compute[72184]: INFO nova.compute.manager [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Took 7.63 seconds to build instance.
Aug 01 17:00:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7df26b9c-efa8-4ba1-a9f6-098b86c26c4c tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.755s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-changed-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Refreshing instance network info cache due to event network-changed-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:00:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] Acquiring lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] Acquired lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Refreshing network info cache for port 1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:00:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updated VIF entry in instance network info cache for port 1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:00:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updating instance_info_cache with network_info: [{"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-35ac3b9b-be48-4835-b45f-227dfc332f35 req-3f3a2b17-4105-409b-ae00-6b3dae08438b service nova] Releasing lock "refresh_cache-d4f11b06-6120-4515-9146-bfd02dad8f12" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'flavor' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:42 user nova-compute[72184]: INFO nova.compute.manager [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Attaching volume 0fe74796-b077-4ffd-ad2f-275538862cf5 to /dev/vdb
Aug 01 17:00:42 user nova-compute[72184]: DEBUG os_brick.utils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a583cc9-20f0-4729-b453-e8172bfd8aa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5ef8b-e2c2-4f13-ab86-c2054adb4226]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37200f71-f971-40f6-bd4f-efa14f0e59e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e97b5ef-2e16-453f-8518-c7b599252eea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:00:42 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b70f488-e0d7-429b-9de4-3810c8c9ccb3]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG os_brick.utils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating existing volume attachment record: ca48dba4-0036-4097-80c1-bdc70592cd8f {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "202a214d-94fc-4748-a403-abdbc75a4157" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:42 user nova-compute[72184]: INFO nova.compute.manager [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Terminating instance
Aug 01 17:00:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-b369eb77-d896-4220-b85a-d88d871a43d1 req-e00ecf31-0fe6-4681-9b4e-f774c6914e5c service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-vif-unplugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b369eb77-d896-4220-b85a-d88d871a43d1 req-e00ecf31-0fe6-4681-9b4e-f774c6914e5c service nova] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b369eb77-d896-4220-b85a-d88d871a43d1 req-e00ecf31-0fe6-4681-9b4e-f774c6914e5c service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b369eb77-d896-4220-b85a-d88d871a43d1 req-e00ecf31-0fe6-4681-9b4e-f774c6914e5c service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-b369eb77-d896-4220-b85a-d88d871a43d1 req-e00ecf31-0fe6-4681-9b4e-f774c6914e5c service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] No waiting events found dispatching network-vif-unplugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-b369eb77-d896-4220-b85a-d88d871a43d1 req-e00ecf31-0fe6-4681-9b4e-f774c6914e5c service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-vif-unplugged-a165456d-91a5-4197-bc19-86eba2a1cec6 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:43 user nova-compute[72184]: INFO nova.compute.manager [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Attaching volume a0f20d1e-6804-442a-8590-2639bae38e6d to /dev/vdb
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_brick.utils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6584f7-6a0b-4877-8d7a-95feacd24cbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf7ae8-1b4c-4019-8740-ff17f8fff060]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4077a3-a82d-4030-aa89-2b5da15cc4df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a4882e-31a4-4fd6-b77e-e2283f3d2bba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:00:43 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03d314-a496-4559-ad34-400f50dc4137]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_brick.utils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updating existing volume attachment record: 31deb004-d5d7-4c44-ab94-8b5585fb1a36 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:00:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Instance destroyed successfully.
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lazy-loading 'resources' on Instance uuid 202a214d-94fc-4748-a403-abdbc75a4157 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2112282104',display_name='tempest-ServersNegativeTestJSON-server-2112282104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2112282104',id=1,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3358e9a5875f4d28b190013ad6eed14b',ramdisk_id='',reservation_id='r-y1pgaobp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2037366998',owner_user_name='tempest-ServersNegativeTestJSON-2037366998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:52:05Z,user_data=None,user_id='d5955b0107544c9cbce9e1c5c305cd3d',uuid=202a214d-94fc-4748-a403-abdbc75a4157,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converting VIF {"id": "a165456d-91a5-4197-bc19-86eba2a1cec6", "address": "fa:16:3e:e5:6a:1e", "network": {"id": "19984e24-10b4-48b9-b337-8c832a9d850c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1116705094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3358e9a5875f4d28b190013ad6eed14b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa165456d-91", "ovs_interfaceid": "a165456d-91a5-4197-bc19-86eba2a1cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG os_vif [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa165456d-91, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:00:43 user nova-compute[72184]: INFO os_vif [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:6a:1e,bridge_name='br-int',has_traffic_filtering=True,id=a165456d-91a5-4197-bc19-86eba2a1cec6,network=Network(19984e24-10b4-48b9-b337-8c832a9d850c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa165456d-91')
Aug 01 17:00:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Deleting instance files /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157_del
Aug 01 17:00:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Deletion of /opt/stack/data/nova/instances/202a214d-94fc-4748-a403-abdbc75a4157_del complete
Aug 01 17:00:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:43 user nova-compute[72184]: INFO nova.compute.manager [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 01 17:00:43 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:00:43 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:00:44 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:44 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Took 0.73 seconds to deallocate network for instance.
Aug 01 17:00:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-26c146f4-c6b4-4fc5-a56d-ff4e9adc1c3a req-356aebe7-0441-4151-b598-592c30475739 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-vif-deleted-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:44 user nova-compute[72184]: INFO nova.compute.manager [req-26c146f4-c6b4-4fc5-a56d-ff4e9adc1c3a req-356aebe7-0441-4151-b598-592c30475739 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Neutron deleted interface a165456d-91a5-4197-bc19-86eba2a1cec6; detaching it from the instance and deleting it from the info cache
Aug 01 17:00:44 user nova-compute[72184]: DEBUG nova.network.neutron [req-26c146f4-c6b4-4fc5-a56d-ff4e9adc1c3a req-356aebe7-0441-4151-b598-592c30475739 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-26c146f4-c6b4-4fc5-a56d-ff4e9adc1c3a req-356aebe7-0441-4151-b598-592c30475739 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Detach interface failed, port_id=a165456d-91a5-4197-bc19-86eba2a1cec6, reason: Instance 202a214d-94fc-4748-a403-abdbc75a4157 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:00:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:45 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Deleted allocations for instance 202a214d-94fc-4748-a403-abdbc75a4157
Aug 01 17:00:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7409665a-7c24-4564-aab8-9e015b671202 tempest-ServersNegativeTestJSON-2037366998 tempest-ServersNegativeTestJSON-2037366998-project-member] Lock "202a214d-94fc-4748-a403-abdbc75a4157" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.514s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-53ab29ee-8a2c-4b67-bcd0-4516e04aa50d req-f1c4ea78-7b86-454b-a111-4b2365933552 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received event network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-53ab29ee-8a2c-4b67-bcd0-4516e04aa50d req-f1c4ea78-7b86-454b-a111-4b2365933552 service nova] Acquiring lock "202a214d-94fc-4748-a403-abdbc75a4157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-53ab29ee-8a2c-4b67-bcd0-4516e04aa50d req-f1c4ea78-7b86-454b-a111-4b2365933552 service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-53ab29ee-8a2c-4b67-bcd0-4516e04aa50d req-f1c4ea78-7b86-454b-a111-4b2365933552 service nova] Lock "202a214d-94fc-4748-a403-abdbc75a4157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-53ab29ee-8a2c-4b67-bcd0-4516e04aa50d req-f1c4ea78-7b86-454b-a111-4b2365933552 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] No waiting events found dispatching network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:45 user nova-compute[72184]: WARNING nova.compute.manager [req-53ab29ee-8a2c-4b67-bcd0-4516e04aa50d req-f1c4ea78-7b86-454b-a111-4b2365933552 service nova] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Received unexpected event network-vif-plugged-a165456d-91a5-4197-bc19-86eba2a1cec6 for instance with vm_state deleted and task_state None.
Aug 01 17:00:47 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:51 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fb3cc7-6b4a-4292-a5a7-8cce1c90494e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:00:51 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f993de-d3f2-4718-91ed-a2a0871f92bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5] added
Aug 01 17:00:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd346cd2-6b65-487b-9d9d-9b5d84d720c9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f97ff41-071d-47ec-aff7-70a615bb9b44]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgJFEoNV {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgJFEoNV" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[754ad167-c3dd-4ae9-80ee-1758b1ae5bf4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgJFEoNV'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[710ca8d3-c9a8-4011-9059-a194f1c29a69]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528d74a-92f3-46b4-a6e2-481ab30af23b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:52 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:52 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed65c2e9-2a59-4318-b8ea-fe9ff3082308]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]
Aug 01 17:00:52 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.
Aug 01 17:00:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7200MB free_disk=25.282573699951172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b76b38-dd8c-4c2c-ac98-be0f656a6451]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2c754c-dde6-4b51-9d90-a6c36dc289b2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:52 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:52 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:52 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:52 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.848s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51b654-e591-4ec5-a338-863cc27622cf]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmORIfUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d4f11b06-6120-4515-9146-bfd02dad8f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance af5bb465-0d7a-4768-b488-c7519b972afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:00:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.884s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== connect_volume: return (1888ms) {'type': 'block', 'scsi_wwn': '23134366164333434', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134366164333434', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.963s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:53 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:53 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'flavor' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c040594b-249b-4bb2-81a1-3bc2f3170bfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:00:53 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:00:53 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:00:53 user nova-compute[72184]:   <source dev="/dev/sdc"/>
Aug 01 17:00:53 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:00:53 user nova-compute[72184]:   <serial>0fe74796-b077-4ffd-ad2f-275538862cf5</serial>
Aug 01 17:00:53 user nova-compute[72184]: </disk>
Aug 01 17:00:53 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e67c9-47f7-457f-86e5-8b6f2948ef07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d] added
Aug 01 17:00:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566d055-721d-41a3-9492-4a73bf68121e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25d2b4c-ad3b-453d-a445-56d5eff65426]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmORIfUc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmORIfUc" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7cf781-9832-4938-9a71-813fa23a45fc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmORIfUc'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd5991-b35c-4227-9163-8f38b0a1bb0b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef8b283-8327-43b4-b1b6-a1c4fe43ed21]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:53 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:53 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:53 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:53 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29550ca4-b82c-45b5-be2d-38ef68b884bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260]
Aug 01 17:00:54 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260] successful.
Aug 01 17:00:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[113040a3-7ebb-4304-89ab-a0c67759157d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e1b33d-f1a1-4024-bdac-191cd084835b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:54 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:54 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:54 user nova-compute[72184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d (non-flash)
Aug 01 17:00:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:54 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:54 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:54 user nova-compute[72184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d (non-flash)
Aug 01 17:00:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f3f0a3-bdcf-4aa6-9c97-14b62d4348e4]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No VIF found with MAC fa:16:3e:0f:89:fd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a54cd32e-ef36-42a8-bf7b-6a103a41dd76 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.415s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:00:55 user nova-compute[72184]: INFO nova.compute.claims [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Claim successful on node user
Aug 01 17:00:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmORIfUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== connect_volume: return (2332ms) {'type': 'block', 'scsi_wwn': '23636393130653062', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636393130653062', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:00:55 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:00:55 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:00:55 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:00:55 user nova-compute[72184]:   <serial>a0f20d1e-6804-442a-8590-2639bae38e6d</serial>
Aug 01 17:00:55 user nova-compute[72184]: </disk>
Aug 01 17:00:55 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:53:08:e3, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:00:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b1003e8f-b7f0-4c02-81a6-0b73c6822057 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.325s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:00:55 user nova-compute[72184]: INFO nova.virt.block_device [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Booting with volume 46a1c925-6b43-4dc8-b091-bb3942763cf8 at /dev/vda
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG os_brick.utils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2e2c5-0174-4dc7-93ea-a729c65e8f08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27af7274-c422-4216-a58a-254d442258bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1becef47-12b7-431d-b474-1b571d424546]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7016978-fa02-47e0-8735-5c06b69356eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:00:56 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad763d-07a1-4c2f-ab4e-99331cde8883]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG os_brick.utils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating existing volume attachment record: 184b3864-6da5-4156-a84c-01f3f2f44b45 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG nova.policy [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dfe9f262c0e43f4a8fe5ffaf61b11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ff26374244a14b18b90ec6cc64470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Stashing vm_state: active {{(pid=72184) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 17:00:56 user nova-compute[72184]: INFO nova.compute.manager [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Detaching volume a0f20d1e-6804-442a-8590-2639bae38e6d
Aug 01 17:00:56 user nova-compute[72184]: INFO nova.virt.block_device [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Attempting to driver detach volume a0f20d1e-6804-442a-8590-2639bae38e6d from mountpoint /dev/vdb
Aug 01 17:00:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully created port: 5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:00:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Attempting to detach device vdb from instance d4f11b06-6120-4515-9146-bfd02dad8f12 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:00:57 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:00:57 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:00:57 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:00:57 user nova-compute[72184]:   <serial>a0f20d1e-6804-442a-8590-2639bae38e6d</serial>
Aug 01 17:00:57 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:00:57 user nova-compute[72184]: </disk>
Aug 01 17:00:57 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:00:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully detached device vdb from instance d4f11b06-6120-4515-9146-bfd02dad8f12 from the persistent domain config.
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f11b06-6120-4515-9146-bfd02dad8f12 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:00:57 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:00:57 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:00:57 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:00:57 user nova-compute[72184]:   <serial>a0f20d1e-6804-442a-8590-2639bae38e6d</serial>
Aug 01 17:00:57 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:00:57 user nova-compute[72184]: </disk>
Aug 01 17:00:57 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'pci_requests' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:00:57 user nova-compute[72184]: INFO nova.compute.claims [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Claim successful on node user
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'resources' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:57 user nova-compute[72184]: INFO nova.compute.resource_tracker [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating resource usage from migration 1849ac1c-0c55-4d44-8f95-28e2654e4530
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909257.4983828, d4f11b06-6120-4515-9146-bfd02dad8f12 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:00:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully detached device vdb from instance d4f11b06-6120-4515-9146-bfd02dad8f12 from the live domain config.
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmORIfUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:57 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b52e0a-50d4-42f7-948d-35d36b4bb1b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b2ca55-a225-4125-80c9-1f54ffc6dea2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:57 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:57 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:57 user nova-compute[72184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d (non-flash)
Aug 01 17:00:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:57 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:57 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:57 user nova-compute[72184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d (non-flash)
Aug 01 17:00:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301846c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully created port: 9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[714ffede-1ed6-410f-a7bb-43c991c1010f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[244dd0d6-dbe1-4314-87cc-8c4b24e877af]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8951efd-aff0-46ac-a644-9df7831a18f0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.602s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:57 user nova-compute[72184]: INFO nova.compute.manager [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Migrating
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: INFO nova.compute.rpcapi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c42c87-411b-451f-8f20-ff0d40e6d147]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d321d51-e616-493e-a46d-7ffb9329da62]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7cf44-546f-4707-b387-7fd02679776d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260]
Aug 01 17:00:57 user nova-compute[72184]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d, portal: 172.16.0.220,3260] successful.
Aug 01 17:00:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f20d1e-6804-442a-8590-2639bae38e6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ae36f-e196-4e53-b3b7-003271989dff]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== disconnect_volume: return (325ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully created port: 46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Starting migrate_disk_and_power_off {{(pid=72184) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909243.7297125, 202a214d-94fc-4748-a403-abdbc75a4157 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:00:58 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] VM Stopped (Lifecycle Event)
Aug 01 17:00:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9a7be017-4961-4646-b45f-4295100df64c None None] [instance: 202a214d-94fc-4748-a403-abdbc75a4157] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-23c2ba1a-11f8-46fa-a96d-cbed058b6401 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.014s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully created port: 6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-5dd92a58-97e0-49aa-810e-b214eaad1b7b req-910c6707-ef79-4f46-9976-b65301ab516c service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5dd92a58-97e0-49aa-810e-b214eaad1b7b req-910c6707-ef79-4f46-9976-b65301ab516c service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5dd92a58-97e0-49aa-810e-b214eaad1b7b req-910c6707-ef79-4f46-9976-b65301ab516c service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5dd92a58-97e0-49aa-810e-b214eaad1b7b req-910c6707-ef79-4f46-9976-b65301ab516c service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-5dd92a58-97e0-49aa-810e-b214eaad1b7b req-910c6707-ef79-4f46-9976-b65301ab516c service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:00:59 user nova-compute[72184]: WARNING nova.compute.manager [req-5dd92a58-97e0-49aa-810e-b214eaad1b7b req-910c6707-ef79-4f46-9976-b65301ab516c service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state active and task_state resize_migrating.
Aug 01 17:00:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance destroyed successfully.
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:00:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc02a82f-c6, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:00:59 user nova-compute[72184]: INFO os_vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6')
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:00:59 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d3663-fdff-4776-8466-1c885d03226f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d05efa-1350-400a-8a2f-39c0cd68526a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:59 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:59 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:00:59 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:00:59 user nova-compute[72184]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:00:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[955390a1-8f9f-4776-844c-7b57b1ecb6f2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f7ca5-d116-419f-bb64-69bc1b09d956]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c825d2-6f06-4f4e-ba9d-d6fdbd00dafa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff5b48-ce7b-4dd0-80d2-3aa7e3ba3dcf]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f1f9c9-5e80-4ed6-a8d1-1f96d0a13bc5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d98a664-df33-4e3a-866e-b600c933663d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]
Aug 01 17:00:59 user nova-compute[72184]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.
Aug 01 17:00:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c466c3-ea75-4648-98d5-82626c5dae7f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== disconnect_volume: return (325ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:00:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully created port: db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d_resize/disk /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "cp -r /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d_resize/disk /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk" returned: 0 in 0.321s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d_resize/disk.info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk.info {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "cp -r /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d_resize/disk.info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk.info" returned: 0 in 0.037s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: 5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:00 user nova-compute[72184]: DEBUG nova.network.neutron [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port 5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG nova.network.neutron [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG nova.network.neutron [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d58a80cf-2589-48ad-a1ac-3edcde4cd336 req-af24c6da-1e2a-4933-a9b1-955f02549b8d service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-1db6f558-bbc3-4731-8af9-ad382a7a19b5 req-b059b366-76ad-4e7b-bdf3-ada037d768a3 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1db6f558-bbc3-4731-8af9-ad382a7a19b5 req-b059b366-76ad-4e7b-bdf3-ada037d768a3 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1db6f558-bbc3-4731-8af9-ad382a7a19b5 req-b059b366-76ad-4e7b-bdf3-ada037d768a3 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1db6f558-bbc3-4731-8af9-ad382a7a19b5 req-b059b366-76ad-4e7b-bdf3-ada037d768a3 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-1db6f558-bbc3-4731-8af9-ad382a7a19b5 req-b059b366-76ad-4e7b-bdf3-ada037d768a3 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:01 user nova-compute[72184]: WARNING nova.compute.manager [req-1db6f558-bbc3-4731-8af9-ad382a7a19b5 req-b059b366-76ad-4e7b-bdf3-ada037d768a3 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state active and task_state resize_migrating.
Aug 01 17:01:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Port fc02a82f-c678-49e6-8196-5213ef90e225 binding to destination host user is already ACTIVE {{(pid=72184) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c797d-6711-4732-853e-95e18bbe4563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91083d1-9d89-4c70-9f32-90bee313438b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3433f4e1-b115-43a2-8b66-e1cb48663d6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8848e632-92b3-4ee1-b3d3-c5528becabfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: 9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-e6a399c0-19c9-40e7-9f15-74b473b7d919. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG nova.network.neutron [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:02 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:01:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c0d9f-6616-49c7-847e-aef50a37ef7f]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG os_brick.utils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b8dd8d5f-be29-4247-b701-2d44260115d9 req-73ae8478-2c0a-480d-87e4-3dfbb113e547 service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: 9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:04 user nova-compute[72184]: INFO nova.virt.block_device [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Booting with volume 95d5d9e2-084a-487f-acde-0579a0265348 at /dev/vdb
Aug 01 17:01:04 user nova-compute[72184]: DEBUG os_brick.utils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14220ab-915e-4c35-ab45-c42d870ba2bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb4864-612d-41d5-9a16-ca72f437e8e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[218adbf4-47a1-482f-b6d2-9c755b44a43a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8fc9a-a3ee-4975-81bf-17cfa9621f7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:04 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:01:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5489a25-1a98-4e6b-9922-583a37fdd8b5]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG os_brick.utils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:04 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating existing volume attachment record: 805268c1-4ed2-4fbf-b018-01c5293caa4f {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: 46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port 9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-9d982e7a-5dfc-4584-86db-84b3b5fffd98. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port 9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-594d2d63-5c93-4698-be27-29f0f2a357ee req-de9e9430-74ab-458f-8c00-58f6c877005f service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: 6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Successfully updated port: db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:01:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:01:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:01:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-46f9d91d-ca2a-476b-9fcc-26982244efd3. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance network_info: |[{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:01:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port 46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updated VIF entry in instance network info cache for port 46f9d91d-ca2a-476b-9fcc-26982244efd3. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-6495593b-1156-493f-bde6-f65ce8176df7. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port 6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updated VIF entry in instance network info cache for port 6495593b-1156-493f-bde6-f65ce8176df7. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-db5f10fc-224d-49f8-bac6-5a342740fe64. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updated VIF entry in instance network info cache for port db5f10fc-224d-49f8-bac6-5a342740fe64. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:01:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-79fe7ac3-886d-4b7e-89b5-11dd513a382a req-28668ead-4d38-4834-adc0-43c1b635c770 service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Starting finish_migration {{(pid=72184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 17:01:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Creating image(s)
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk. size=21474836480 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk 21474836480 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk 21474836480" returned: 0 in 0.045s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Ensure instance console log exists: /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start _get_guest_xml network_info=[{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'bc27da87-e702-428b-b321-eda5209d1221', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1ba84814-1a19-453e-9482-3fae91ae857d', 'attached_at': '2023-08-01T17:01:11.000000', 'detached_at': '', 'volume_id': '0fe74796-b077-4ffd-ad2f-275538862cf5', 'serial': '0fe74796-b077-4ffd-ad2f-275538862cf5'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:01:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:01:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:48:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:11 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a35c7-5312-4f22-b699-b9aba532a711]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:11 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[048b7f9b-95c1-4bbd-8c8b-d7e46bad4948]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5] added
Aug 01 17:01:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1860b10-3181-434e-ae18-c7695d5286aa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[249166f9-63f4-43b8-97b4-e0e76976ad9f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgJFEoNV {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgJFEoNV" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0ba09-b0f6-4df5-895b-7d5dcc33d744]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgJFEoNV'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c111c-d6b0-4bbb-8cae-d5f9a2d5f5e9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a122ca00-12df-4770-aee3-7dc40711f973]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:11 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:11 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82f4252-a38d-42a9-b2ce-239c9f88b1a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]
Aug 01 17:01:11 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1040529-c766-44dd-b11e-f3dc094ebb3e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f60f035-6015-4b48-a13b-74998506802d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:11 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:11 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:11 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:11 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a2aa5-272c-4dff-9ae3-a369e97df758]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23134366164333434', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134366164333434', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:01:12 user nova-compute[72184]:   <uuid>1ba84814-1a19-453e-9482-3fae91ae857d</uuid>
Aug 01 17:01:12 user nova-compute[72184]:   <name>instance-00000013</name>
Aug 01 17:01:12 user nova-compute[72184]:   <memory>2097152</memory>
Aug 01 17:01:12 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:01:12 user nova-compute[72184]:   <metadata>
Aug 01 17:01:12 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:01:12 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:01:12 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherB-server-1980360680</nova:name>
Aug 01 17:01:12 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:01:11</nova:creationTime>
Aug 01 17:01:12 user nova-compute[72184]:       <nova:flavor name="m1.small">
Aug 01 17:01:12 user nova-compute[72184]:         <nova:memory>2048</nova:memory>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:disk>20</nova:disk>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:01:12 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:01:12 user nova-compute[72184]:       <nova:owner>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:user uuid="8cb37dea792d4fc98ac32d9c282020d6">tempest-ServerActionsTestOtherB-1303337288-project-member</nova:user>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:project uuid="955f909d63034bc8ace106364f8d9b96">tempest-ServerActionsTestOtherB-1303337288</nova:project>
Aug 01 17:01:12 user nova-compute[72184]:       </nova:owner>
Aug 01 17:01:12 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:01:12 user nova-compute[72184]:       <nova:ports>
Aug 01 17:01:12 user nova-compute[72184]:         <nova:port uuid="fc02a82f-c678-49e6-8196-5213ef90e225">
Aug 01 17:01:12 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 17:01:12 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:12 user nova-compute[72184]:       </nova:ports>
Aug 01 17:01:12 user nova-compute[72184]:     </nova:instance>
Aug 01 17:01:12 user nova-compute[72184]:   </metadata>
Aug 01 17:01:12 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:01:12 user nova-compute[72184]:     <system>
Aug 01 17:01:12 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:01:12 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:01:12 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:01:12 user nova-compute[72184]:       <entry name="serial">1ba84814-1a19-453e-9482-3fae91ae857d</entry>
Aug 01 17:01:12 user nova-compute[72184]:       <entry name="uuid">1ba84814-1a19-453e-9482-3fae91ae857d</entry>
Aug 01 17:01:12 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:01:12 user nova-compute[72184]:     </system>
Aug 01 17:01:12 user nova-compute[72184]:   </sysinfo>
Aug 01 17:01:12 user nova-compute[72184]:   <os>
Aug 01 17:01:12 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:01:12 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:01:12 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:01:12 user nova-compute[72184]:   </os>
Aug 01 17:01:12 user nova-compute[72184]:   <features>
Aug 01 17:01:12 user nova-compute[72184]:     <acpi/>
Aug 01 17:01:12 user nova-compute[72184]:     <apic/>
Aug 01 17:01:12 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:01:12 user nova-compute[72184]:   </features>
Aug 01 17:01:12 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:01:12 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:01:12 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:01:12 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:01:12 user nova-compute[72184]:   </clock>
Aug 01 17:01:12 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:01:12 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:01:12 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:01:12 user nova-compute[72184]:   </cpu>
Aug 01 17:01:12 user nova-compute[72184]:   <devices>
Aug 01 17:01:12 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:01:12 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:01:12 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk"/>
Aug 01 17:01:12 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:01:12 user nova-compute[72184]:     </disk>
Aug 01 17:01:12 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:01:12 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:12 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:01:12 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:01:12 user nova-compute[72184]:       <serial>0fe74796-b077-4ffd-ad2f-275538862cf5</serial>
Aug 01 17:01:12 user nova-compute[72184]:     </disk>
Aug 01 17:01:12 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:12 user nova-compute[72184]:       <mac address="fa:16:3e:0f:89:fd"/>
Aug 01 17:01:12 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:12 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:12 user nova-compute[72184]:       <target dev="tapfc02a82f-c6"/>
Aug 01 17:01:12 user nova-compute[72184]:     </interface>
Aug 01 17:01:12 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:01:12 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/console.log" append="off"/>
Aug 01 17:01:12 user nova-compute[72184]:     </serial>
Aug 01 17:01:12 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:01:12 user nova-compute[72184]:     <video>
Aug 01 17:01:12 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:12 user nova-compute[72184]:     </video>
Aug 01 17:01:12 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:01:12 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:01:12 user nova-compute[72184]:     </rng>
Aug 01 17:01:12 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:01:12 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:01:12 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:01:12 user nova-compute[72184]:     </memballoon>
Aug 01 17:01:12 user nova-compute[72184]:   </devices>
Aug 01 17:01:12 user nova-compute[72184]: </domain>
Aug 01 17:01:12 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-727576488-network", "vif_mac": "fa:16:3e:0f:89:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc02a82f-c6, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc02a82f-c6, col_values=(('external_ids', {'iface-id': 'fc02a82f-c678-49e6-8196-5213ef90e225', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:89:fd', 'vm-uuid': '1ba84814-1a19-453e-9482-3fae91ae857d'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:13 user nova-compute[72184]: INFO os_vif [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6')
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] No VIF found with MAC fa:16:3e:0f:89:fd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:01:13 user nova-compute[72184]: INFO nova.virt.block_device [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Booting with volume 83c9e834-6335-4be3-94ef-e67ebfe98243 at /dev/vdc
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_brick.utils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca92ac2-c27b-4ea0-a009-28c954474b5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b882ebe9-21bb-49a0-8c9e-3976344c256c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe08dd-e543-44e7-ba63-bfb916df97f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf8bc4-5dbb-493c-aa35-140281f83b77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:13 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:01:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86345151-e3da-4f89-a4c7-e660816a8d7d]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG os_brick.utils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating existing volume attachment record: 67356a81-9b3e-4202-8dfb-0da0e3b15152 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:01:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909259.3719447, 1ba84814-1a19-453e-9482-3fae91ae857d => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:14 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Stopped (Lifecycle Event)
Aug 01 17:01:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-765182d5-8205-4ec1-9511-a8e613e21bfe None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-060506d3-9bbc-4f68-b6f3-b3458918176a req-4314ec47-58ec-479a-817a-9c8ec5d42211 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-060506d3-9bbc-4f68-b6f3-b3458918176a req-4314ec47-58ec-479a-817a-9c8ec5d42211 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-060506d3-9bbc-4f68-b6f3-b3458918176a req-4314ec47-58ec-479a-817a-9c8ec5d42211 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-060506d3-9bbc-4f68-b6f3-b3458918176a req-4314ec47-58ec-479a-817a-9c8ec5d42211 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-060506d3-9bbc-4f68-b6f3-b3458918176a req-4314ec47-58ec-479a-817a-9c8ec5d42211 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:14 user nova-compute[72184]: WARNING nova.compute.manager [req-060506d3-9bbc-4f68-b6f3-b3458918176a req-4314ec47-58ec-479a-817a-9c8ec5d42211 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state active and task_state resize_finish.
Aug 01 17:01:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-8cf9511e-bfb5-45ab-8d92-2e596216d138 req-d5c48ced-f345-4193-9524-0b2368a0e0a5 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cf9511e-bfb5-45ab-8d92-2e596216d138 req-d5c48ced-f345-4193-9524-0b2368a0e0a5 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cf9511e-bfb5-45ab-8d92-2e596216d138 req-d5c48ced-f345-4193-9524-0b2368a0e0a5 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8cf9511e-bfb5-45ab-8d92-2e596216d138 req-d5c48ced-f345-4193-9524-0b2368a0e0a5 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-8cf9511e-bfb5-45ab-8d92-2e596216d138 req-d5c48ced-f345-4193-9524-0b2368a0e0a5 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:17 user nova-compute[72184]: WARNING nova.compute.manager [req-8cf9511e-bfb5-45ab-8d92-2e596216d138 req-d5c48ced-f345-4193-9524-0b2368a0e0a5 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state active and task_state resize_finish.
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909277.0915911, 1ba84814-1a19-453e-9482-3fae91ae857d => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Resumed (Lifecycle Event)
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:01:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance running successfully.
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Failed to set time: agent not configured {{(pid=72184) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f7a75b42-73d5-4eaa-af03-4d99aa0471a6 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] finish_migration finished successfully. {{(pid=72184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 17:01:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909277.0932765, 1ba84814-1a19-453e-9482-3fae91ae857d => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Started (Lifecycle Event)
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:01:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 17:01:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'flavor' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:20 user nova-compute[72184]: INFO nova.compute.manager [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attaching volume 702dfe35-44fa-40aa-a730-faaedfa48bd8 to /dev/vdb
Aug 01 17:01:20 user nova-compute[72184]: DEBUG os_brick.utils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e695b7c3-db3f-4451-8b28-f21254cd152e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8cd94-8ed0-4e0b-af23-d357e49260bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae30eb-b45c-4812-a361-407b516272df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d90ae-6a89-4c26-9eba-515490913e48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:20 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:01:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0709b7-710f-4dd7-ac16-a72a48caa17e]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG os_brick.utils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:20 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating existing volume attachment record: a6497a45-ea2b-4022-a552-a42280e695fd {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:01:22 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Creating image(s)
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Ensure instance console log exists: /opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Start _get_guest_xml network_info=[{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '184b3864-6da5-4156-a84c-01f3f2f44b45', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcurhzvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7', 'attached_at': '', 'detached_at': '', 'volume_id': '46a1c925-6b43-4dc8-b091-bb3942763cf8', 'serial': '46a1c925-6b43-4dc8-b091-bb3942763cf8'}, 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '805268c1-4ed2-4fbf-b018-01c5293caa4f', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiPzMpmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7', 'attached_at': '', 'detached_at': '', 'volume_id': '95d5d9e2-084a-487f-acde-0579a0265348', 'serial': '95d5d9e2-084a-487f-acde-0579a0265348'}, 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '67356a81-9b3e-4202-8dfb-0da0e3b15152', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpoMObgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7', 'attached_at': '', 'detached_at': '', 'volume_id': '83c9e834-6335-4be3-94ef-e67ebfe98243', 'serial': '83c9e834-6335-4be3-94ef-e67ebfe98243'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:01:22 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:01:22 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcurhzvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:22 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:22 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:22 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3308aa-ef7b-4a8d-ae75-2627c3ecfb48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:22 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2597c39a-226c-4b3d-874d-c5fb8f6e055e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8] added
Aug 01 17:01:22 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[541369dc-af40-436d-b14e-fe25e3a471cd]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c552c3-aa08-47da-adc0-9355692865c8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GcurhzvT {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GcurhzvT" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d54a13-df9b-4b93-877a-ff8dca3b4b25]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GcurhzvT'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e946bf12-d0a1-4313-b849-f6e875a36192]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acb79ee-3947-402b-b22d-85c2366aac50]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf71d1-ce7a-4643-a0c8-35a4096e1f0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260]
Aug 01 17:01:23 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb9ea32-a970-46db-9d66-33688f6f568d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9200b-de43-41aa-a289-3615d4644e60]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98deb6d0-b7df-4b94-9cce-0ece7b8806f9]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcurhzvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23532323537633032', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532323537633032', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiPzMpmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:24 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:24 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:24 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f55d12-7bfd-42f2-a8b5-459ec07df4be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:24 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5329ba4c-53ee-4f99-ad37-6a9cf0a1bc8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348] added
Aug 01 17:01:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c6c1f-cc22-4cbf-a1e4-5e621aad4959]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95fcec2-277b-475b-8891-75d5f6287971]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiPzMpmI {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiPzMpmI" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d9e7a5-c47a-444c-aca4-8dd58bead1ec]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiPzMpmI'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0653a8-e652-4da9-b74e-58830075ec9d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaeb4fd-0e6c-46e1-a1aa-ded6d35f4cda]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[700955a8-3568-44bb-ad5c-b0289dd848fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260]
Aug 01 17:01:24 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53858f5-e08b-43cb-b729-922dd4816a94]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37205386-8eb0-41ea-9cf6-efee534d1b17]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[520989be-4dbe-480e-9161-330f21b2d8f2]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiPzMpmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26165346332646262', 'path': '/dev/sde'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165346332646262', 'path': '/dev/sde'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpoMObgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:25 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:25 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:25 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a1d77-04ef-47bf-b628-d8f5d2a307f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:25 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead770e-0d5c-4226-84ee-01bcbca3fa26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243] added
Aug 01 17:01:25 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc98a6c-8a73-41da-8d37-03a18551f1e0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a24b6-16ba-45b5-a964-4ad5b406f33c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpoMObgH {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpoMObgH" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c1a9e-2797-481f-926f-682e540c3522]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hpoMObgH'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d621e7-3452-40f0-a64f-e3f1ff97f289]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07e84d-50a0-459f-8b72-571689d7ccad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:25 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eb9794-a0fc-48bc-82a0-0a683054dd66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260]
Aug 01 17:01:26 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b835b8-bc41-4f52-8320-75fd50bcaa89]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07798fb4-2016-4e23-b9cc-77d2e49c9b99]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63df176c-f17e-40f6-bab7-919952ac7abe]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpoMObgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23430393039613531', 'path': '/dev/sdf'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430393039613531', 'path': '/dev/sdf'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:01:27 user nova-compute[72184]:   <uuid>6b34f6e1-e9cb-4420-917f-2078cdd8e0e7</uuid>
Aug 01 17:01:27 user nova-compute[72184]:   <name>instance-0000001a</name>
Aug 01 17:01:27 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:01:27 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:01:27 user nova-compute[72184]:   <metadata>
Aug 01 17:01:27 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:01:27 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:01:27 user nova-compute[72184]:       <nova:name>tempest-device-tagging-server-1870136684</nova:name>
Aug 01 17:01:27 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:01:22</nova:creationTime>
Aug 01 17:01:27 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:01:27 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:01:27 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:01:27 user nova-compute[72184]:       <nova:owner>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:user uuid="7dfe9f262c0e43f4a8fe5ffaf61b11de">tempest-TaggedBootDevicesTest-625177496-project-member</nova:user>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:project uuid="1c8ff26374244a14b18b90ec6cc64470">tempest-TaggedBootDevicesTest-625177496</nova:project>
Aug 01 17:01:27 user nova-compute[72184]:       </nova:owner>
Aug 01 17:01:27 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:01:27 user nova-compute[72184]:       <nova:ports>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="5cacaa56-cc77-4ea8-943d-17ca5e93a7dd">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="e6a399c0-19c9-40e7-9f15-74b473b7d919">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="9a5be4ec-cc9b-4990-8ef8-d57b8257f37e">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="9d982e7a-5dfc-4584-86db-84b3b5fffd98">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="46f9d91d-ca2a-476b-9fcc-26982244efd3">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="6495593b-1156-493f-bde6-f65ce8176df7">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:         <nova:port uuid="db5f10fc-224d-49f8-bac6-5a342740fe64">
Aug 01 17:01:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 17:01:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:27 user nova-compute[72184]:       </nova:ports>
Aug 01 17:01:27 user nova-compute[72184]:     </nova:instance>
Aug 01 17:01:27 user nova-compute[72184]:   </metadata>
Aug 01 17:01:27 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:01:27 user nova-compute[72184]:     <system>
Aug 01 17:01:27 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:01:27 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:01:27 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:01:27 user nova-compute[72184]:       <entry name="serial">6b34f6e1-e9cb-4420-917f-2078cdd8e0e7</entry>
Aug 01 17:01:27 user nova-compute[72184]:       <entry name="uuid">6b34f6e1-e9cb-4420-917f-2078cdd8e0e7</entry>
Aug 01 17:01:27 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:01:27 user nova-compute[72184]:     </system>
Aug 01 17:01:27 user nova-compute[72184]:   </sysinfo>
Aug 01 17:01:27 user nova-compute[72184]:   <os>
Aug 01 17:01:27 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:01:27 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:01:27 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:01:27 user nova-compute[72184]:   </os>
Aug 01 17:01:27 user nova-compute[72184]:   <features>
Aug 01 17:01:27 user nova-compute[72184]:     <acpi/>
Aug 01 17:01:27 user nova-compute[72184]:     <apic/>
Aug 01 17:01:27 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:01:27 user nova-compute[72184]:   </features>
Aug 01 17:01:27 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:01:27 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:01:27 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:01:27 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:01:27 user nova-compute[72184]:   </clock>
Aug 01 17:01:27 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:01:27 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:01:27 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:01:27 user nova-compute[72184]:   </cpu>
Aug 01 17:01:27 user nova-compute[72184]:   <devices>
Aug 01 17:01:27 user nova-compute[72184]:     <disk type="file" device="cdrom">
Aug 01 17:01:27 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 17:01:27 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7/disk.config"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="hda" bus="ide"/>
Aug 01 17:01:27 user nova-compute[72184]:     </disk>
Aug 01 17:01:27 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:01:27 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:27 user nova-compute[72184]:       <source dev="/dev/sdd"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <serial>46a1c925-6b43-4dc8-b091-bb3942763cf8</serial>
Aug 01 17:01:27 user nova-compute[72184]:     </disk>
Aug 01 17:01:27 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:01:27 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:27 user nova-compute[72184]:       <source dev="/dev/sde"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <serial>95d5d9e2-084a-487f-acde-0579a0265348</serial>
Aug 01 17:01:27 user nova-compute[72184]:     </disk>
Aug 01 17:01:27 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:01:27 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:27 user nova-compute[72184]:       <source dev="/dev/sdf"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="vdc" bus="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <serial>83c9e834-6335-4be3-94ef-e67ebfe98243</serial>
Aug 01 17:01:27 user nova-compute[72184]:     </disk>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:f8:64:47"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tap5cacaa56-cc"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:56:da:30"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tape6a399c0-19"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:9c:b3:98"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tap9a5be4ec-cc"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:08:57:6e"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tap9d982e7a-5d"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:94:fb:c8"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tap46f9d91d-ca"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:74:ce:50"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tap6495593b-11"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:27 user nova-compute[72184]:       <mac address="fa:16:3e:fc:37:2b"/>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:27 user nova-compute[72184]:       <target dev="tapdb5f10fc-22"/>
Aug 01 17:01:27 user nova-compute[72184]:     </interface>
Aug 01 17:01:27 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:01:27 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7/console.log" append="off"/>
Aug 01 17:01:27 user nova-compute[72184]:     </serial>
Aug 01 17:01:27 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:01:27 user nova-compute[72184]:     <video>
Aug 01 17:01:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:27 user nova-compute[72184]:     </video>
Aug 01 17:01:27 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:01:27 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:01:27 user nova-compute[72184]:     </rng>
Aug 01 17:01:27 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:01:27 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:01:27 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:01:27 user nova-compute[72184]:     </memballoon>
Aug 01 17:01:27 user nova-compute[72184]:   </devices>
Aug 01 17:01:27 user nova-compute[72184]: </domain>
Aug 01 17:01:27 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cacaa56-cc, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cacaa56-cc, col_values=(('external_ids', {'iface-id': '5cacaa56-cc77-4ea8-943d-17ca5e93a7dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:64:47', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6a399c0-19, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6a399c0-19, col_values=(('external_ids', {'iface-id': 'e6a399c0-19c9-40e7-9f15-74b473b7d919', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:da:30', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a5be4ec-cc, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a5be4ec-cc, col_values=(('external_ids', {'iface-id': '9a5be4ec-cc9b-4990-8ef8-d57b8257f37e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b3:98', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d982e7a-5d, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d982e7a-5d, col_values=(('external_ids', {'iface-id': '9d982e7a-5dfc-4584-86db-84b3b5fffd98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:57:6e', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46f9d91d-ca, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46f9d91d-ca, col_values=(('external_ids', {'iface-id': '46f9d91d-ca2a-476b-9fcc-26982244efd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:fb:c8', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6495593b-11, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6495593b-11, col_values=(('external_ids', {'iface-id': '6495593b-1156-493f-bde6-f65ce8176df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:ce:50', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb5f10fc-22, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb5f10fc-22, col_values=(('external_ids', {'iface-id': 'db5f10fc-224d-49f8-bac6-5a342740fe64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:37:2b', 'vm-uuid': '6b34f6e1-e9cb-4420-917f-2078cdd8e0e7'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:27 user nova-compute[72184]: INFO os_vif [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22')
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] No BDM found with device name hda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] No VIF found with MAC fa:16:3e:f8:64:47, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] No VIF found with MAC fa:16:3e:94:fb:c8, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:01:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Using config drive
Aug 01 17:01:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Creating config drive at /opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7/disk.config
Aug 01 17:01:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8gxpu12b {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8gxpu12b" returned: 0 in 0.056s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-ca9bce09-cef2-470f-900b-f82255c2ffaf req-e1d9ddb1-f216-497a-b31a-ea8061b78961 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ca9bce09-cef2-470f-900b-f82255c2ffaf req-e1d9ddb1-f216-497a-b31a-ea8061b78961 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ca9bce09-cef2-470f-900b-f82255c2ffaf req-e1d9ddb1-f216-497a-b31a-ea8061b78961 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ca9bce09-cef2-470f-900b-f82255c2ffaf req-e1d9ddb1-f216-497a-b31a-ea8061b78961 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-ca9bce09-cef2-470f-900b-f82255c2ffaf req-e1d9ddb1-f216-497a-b31a-ea8061b78961 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:29 user nova-compute[72184]: WARNING nova.compute.manager [req-ca9bce09-cef2-470f-900b-f82255c2ffaf req-e1d9ddb1-f216-497a-b31a-ea8061b78961 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd for instance with vm_state building and task_state spawning.
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-749262cc-9d36-4e6b-80a4-f3d9fb7da15d req-9aa55f44-d550-4d24-9fbd-d4b3b3cedd9a service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-749262cc-9d36-4e6b-80a4-f3d9fb7da15d req-9aa55f44-d550-4d24-9fbd-d4b3b3cedd9a service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-749262cc-9d36-4e6b-80a4-f3d9fb7da15d req-9aa55f44-d550-4d24-9fbd-d4b3b3cedd9a service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-749262cc-9d36-4e6b-80a4-f3d9fb7da15d req-9aa55f44-d550-4d24-9fbd-d4b3b3cedd9a service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-749262cc-9d36-4e6b-80a4-f3d9fb7da15d req-9aa55f44-d550-4d24-9fbd-d4b3b3cedd9a service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:30 user nova-compute[72184]: WARNING nova.compute.manager [req-749262cc-9d36-4e6b-80a4-f3d9fb7da15d req-9aa55f44-d550-4d24-9fbd-d4b3b3cedd9a service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 for instance with vm_state building and task_state spawning.
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:31 user nova-compute[72184]: WARNING nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd for instance with vm_state building and task_state spawning.
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:31 user nova-compute[72184]: WARNING nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e for instance with vm_state building and task_state spawning.
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:31 user nova-compute[72184]: WARNING nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e for instance with vm_state building and task_state spawning.
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:31 user nova-compute[72184]: WARNING nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 for instance with vm_state building and task_state spawning.
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:31 user nova-compute[72184]: WARNING nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 for instance with vm_state building and task_state spawning.
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:31 user nova-compute[72184]: WARNING nova.compute.manager [req-a76b6a13-acc0-4685-81d9-0c8ad0fa9ae4 req-2d89bd84-5a46-4148-85b4-a94d45ac96e0 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 for instance with vm_state building and task_state spawning.
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:32 user nova-compute[72184]: WARNING nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 for instance with vm_state building and task_state spawning.
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:32 user nova-compute[72184]: WARNING nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 for instance with vm_state building and task_state spawning.
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:32 user nova-compute[72184]: WARNING nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 for instance with vm_state building and task_state spawning.
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:32 user nova-compute[72184]: WARNING nova.compute.manager [req-164f7f12-706d-4ada-9fe7-5a05703830d9 req-1d368525-baed-44d3-a41a-433b02d6fb2f service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 for instance with vm_state building and task_state spawning.
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:32 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:32 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:32 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a2ff50-d3bd-4cab-a487-6b332f78506d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:32 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd54a65c-029c-4715-85e3-5ccfa1575290]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8] added
Aug 01 17:01:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f7ca5-1545-409b-882c-ca9c07aebe5d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb734ac-7f2d-4079-9f51-1c142cb5fe2f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksADmbOf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksADmbOf" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172bfb0-f011-459c-af4b-3483e6898b3f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksADmbOf'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba0a7a1-08dc-421c-bc1f-1bced6db3c5f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88c368-a590-4dc3-984a-08f514f91ef0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f24eebd-1eba-4bae-84c9-8067cee7ca41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]
Aug 01 17:01:32 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e968fa66-c7e3-4d25-9820-8b32e0142c4f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d752a3fd-6b3c-469a-a621-29aafd847851]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a9c9b-53dd-434d-8c38-fc43dec3435a]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lazy-loading 'flavor' on Instance uuid af5bb465-0d7a-4768-b488-c7519b972afd {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:33 user nova-compute[72184]: INFO nova.compute.manager [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Attaching volume 5891de96-c6b8-4697-8781-d69bd056134c to /dev/vdb
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.utils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2fee41-7c6b-4f18-add9-19fde4fbba90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b361f695-6206-4aea-9167-d7413e420bc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cbe13a-62c4-4d35-8bee-65c71674de33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deaf033-62fd-4c3d-be36-edef7d838499]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:33 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:01:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b58e5-9882-45cb-8d41-cc79d16c4456]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.utils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Updating existing volume attachment record: f3beeac5-59f8-4209-a977-960e17a6136b {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909293.83246, 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] VM Resumed (Lifecycle Event)
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:01:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance spawned successfully.
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23635373932363461', 'path': '/dev/sdg'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635373932363461', 'path': '/dev/sdg'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'flavor' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909293.8407943, 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] VM Started (Lifecycle Event)
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:01:33 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:01:34 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:34 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 17:01:34 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:01:34 user nova-compute[72184]:   <serial>702dfe35-44fa-40aa-a730-faaedfa48bd8</serial>
Aug 01 17:01:34 user nova-compute[72184]: </disk>
Aug 01 17:01:34 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-6c0a9b71-c5cc-449b-807b-43e80a313ca8 req-e1ec6a5f-c062-48d2-81f8-570e55b486c9 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6c0a9b71-c5cc-449b-807b-43e80a313ca8 req-e1ec6a5f-c062-48d2-81f8-570e55b486c9 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6c0a9b71-c5cc-449b-807b-43e80a313ca8 req-e1ec6a5f-c062-48d2-81f8-570e55b486c9 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6c0a9b71-c5cc-449b-807b-43e80a313ca8 req-e1ec6a5f-c062-48d2-81f8-570e55b486c9 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-6c0a9b71-c5cc-449b-807b-43e80a313ca8 req-e1ec6a5f-c062-48d2-81f8-570e55b486c9 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:34 user nova-compute[72184]: WARNING nova.compute.manager [req-6c0a9b71-c5cc-449b-807b-43e80a313ca8 req-e1ec6a5f-c062-48d2-81f8-570e55b486c9 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 for instance with vm_state building and task_state spawning.
Aug 01 17:01:34 user nova-compute[72184]: INFO nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Took 11.31 seconds to spawn the instance on the hypervisor.
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:34 user nova-compute[72184]: INFO nova.compute.manager [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Took 39.14 seconds to build instance.
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6f359ff2-1fb0-4b7e-ae7e-8f385a8a50e3 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.254s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-f6807788-f786-4e2a-bd7c-cf5756817bf2 req-e9b674aa-c667-43b0-8882-ac9f5f3ca231 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f6807788-f786-4e2a-bd7c-cf5756817bf2 req-e9b674aa-c667-43b0-8882-ac9f5f3ca231 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f6807788-f786-4e2a-bd7c-cf5756817bf2 req-e9b674aa-c667-43b0-8882-ac9f5f3ca231 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f6807788-f786-4e2a-bd7c-cf5756817bf2 req-e9b674aa-c667-43b0-8882-ac9f5f3ca231 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-f6807788-f786-4e2a-bd7c-cf5756817bf2 req-e9b674aa-c667-43b0-8882-ac9f5f3ca231 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:34 user nova-compute[72184]: WARNING nova.compute.manager [req-f6807788-f786-4e2a-bd7c-cf5756817bf2 req-e9b674aa-c667-43b0-8882-ac9f5f3ca231 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 for instance with vm_state active and task_state None.
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No VIF found with MAC fa:16:3e:f4:23:78, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:01:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f688893c-4dae-4e3d-92d0-35c979a59e35 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.459s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:36 user nova-compute[72184]: INFO nova.compute.manager [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Rebuilding instance
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'trusted_certs' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'pci_requests' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'pci_devices' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'resources' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'migration_context' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72184) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance destroyed successfully.
Aug 01 17:01:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-e4a634c2-1b6f-4145-8897-86fe4c6b04f2 req-643df2b1-a472-4bf8-9447-11e9e1f183ba service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-unplugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e4a634c2-1b6f-4145-8897-86fe4c6b04f2 req-643df2b1-a472-4bf8-9447-11e9e1f183ba service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e4a634c2-1b6f-4145-8897-86fe4c6b04f2 req-643df2b1-a472-4bf8-9447-11e9e1f183ba service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e4a634c2-1b6f-4145-8897-86fe4c6b04f2 req-643df2b1-a472-4bf8-9447-11e9e1f183ba service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-e4a634c2-1b6f-4145-8897-86fe4c6b04f2 req-643df2b1-a472-4bf8-9447-11e9e1f183ba service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-unplugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:37 user nova-compute[72184]: WARNING nova.compute.manager [req-e4a634c2-1b6f-4145-8897-86fe4c6b04f2 req-643df2b1-a472-4bf8-9447-11e9e1f183ba service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-unplugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state active and task_state rebuilding.
Aug 01 17:01:37 user nova-compute[72184]: INFO nova.compute.manager [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Detaching volume 702dfe35-44fa-40aa-a730-faaedfa48bd8
Aug 01 17:01:37 user nova-compute[72184]: INFO nova.virt.block_device [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attempting to driver detach volume 702dfe35-44fa-40aa-a730-faaedfa48bd8 from mountpoint /dev/vdb
Aug 01 17:01:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Attempting to detach device vdb from instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:01:37 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:37 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 17:01:37 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:01:37 user nova-compute[72184]:   <serial>702dfe35-44fa-40aa-a730-faaedfa48bd8</serial>
Aug 01 17:01:37 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:01:37 user nova-compute[72184]: </disk>
Aug 01 17:01:37 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:01:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully detached device vdb from instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f from the persistent domain config.
Aug 01 17:01:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:37 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0117c05f-616a-4979-9e69-8e6fb666273b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee44ebd-c3e1-4d5b-9831-0f15d08370fa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30279a5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'): ({'sdg'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Removing single pathed devices sdg {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:01:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef325dd-6655-4005-b1d2-771c13678d46]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4223cebe-4514-46c6-bfd0-10100a05a3cc]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flushing IO for device /dev/sdg {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91685f5d-c90c-4439-8a38-7d1574593d42]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ecc88-4a91-4923-a1fb-23851f9d6d8f]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf01a7-55b8-42c7-af90-fb87e4beeb4b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e5eb7b-3c99-4368-ae43-9a5a2db6dba0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]
Aug 01 17:01:38 user nova-compute[72184]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:38 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae9677-fef4-4328-ad38-e2e4d353bf71]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== disconnect_volume: return (387ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance destroyed successfully.
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-163759626',display_name='tempest-ServerActionsTestOtherA-server-483945621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-163759626',id=20,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-smryrd3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:01:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=99df3b11-5b8e-4d64-bd50-fd9a4a7f821f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c311e0-02, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:39 user nova-compute[72184]: INFO os_vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02')
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:39 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdf01c-cd3d-47c6-a442-f1a7ddc98c10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2b199-822f-4b3e-9bcd-e9a59452f085]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30279a43a0>, {}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Disconnecting from: [] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== disconnect_volume: return (77ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:01:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Deleting instance files /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f_del
Aug 01 17:01:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Deletion of /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f_del complete
Aug 01 17:01:39 user nova-compute[72184]: INFO nova.virt.block_device [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Booting with volume 702dfe35-44fa-40aa-a730-faaedfa48bd8 at /dev/vdb
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b50cac6-ad8a-40a2-bf1c-1a2b23c7fb69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-762b0978-f845-4c9f-9bf6-2b05f492d0f1 req-c73e441f-7727-41f8-abde-ffb60c136143 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-762b0978-f845-4c9f-9bf6-2b05f492d0f1 req-c73e441f-7727-41f8-abde-ffb60c136143 service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-762b0978-f845-4c9f-9bf6-2b05f492d0f1 req-c73e441f-7727-41f8-abde-ffb60c136143 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-762b0978-f845-4c9f-9bf6-2b05f492d0f1 req-c73e441f-7727-41f8-abde-ffb60c136143 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-762b0978-f845-4c9f-9bf6-2b05f492d0f1 req-c73e441f-7727-41f8-abde-ffb60c136143 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:39 user nova-compute[72184]: WARNING nova.compute.manager [req-762b0978-f845-4c9f-9bf6-2b05f492d0f1 req-c73e441f-7727-41f8-abde-ffb60c136143 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f66e4-0a61-44b9-829c-3d18b0b47840]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dbf2b6-d80a-40a2-b64c-da71086d5a1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19343b5-c8be-4836-b52a-662a5e1e87d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:01:39 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:01:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b81b5b-9814-4b96-ac5a-5a467d83c81c]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:39 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating existing volume attachment record: 1f9eac73-7fc3-46c6-8bbc-09a28465c7a3 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:01:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muGcMNLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:42 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ef5584-a948-4f9f-bac2-06e5282daba3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:42 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5160e590-8257-46c0-83fb-c59b602502a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c] added
Aug 01 17:01:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1612a40-09fa-4234-9ee9-8b986630af89]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeee396-d7cf-48b8-b32c-2108e5aa96f8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muGcMNLr {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muGcMNLr" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6831b81a-df91-4cdd-91ec-d58f34cc2cb7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muGcMNLr'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[274538cc-b041-48f4-b342-83b5cbb129a3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[631ed56f-470d-4034-91af-4e5459636bb7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56941853-b462-4b04-a88a-b6ba9f95aa1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260]
Aug 01 17:01:43 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ce8d7-eaaf-42f5-bd9e-4eacfc73eb24]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba9483-b5e7-4309-ab63-d80ab322a0c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c (non-flash)
Aug 01 17:01:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:43 user nova-compute[72184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c (non-flash)
Aug 01 17:01:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5825c30b-3357-4e01-9429-4eb5e467bd09]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muGcMNLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26562356164386537', 'path': '/dev/sdg'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562356164386537', 'path': '/dev/sdg'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lazy-loading 'flavor' on Instance uuid af5bb465-0d7a-4768-b488-c7519b972afd {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:01:44 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:44 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 17:01:44 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:01:44 user nova-compute[72184]:   <serial>5891de96-c6b8-4697-8781-d69bd056134c</serial>
Aug 01 17:01:44 user nova-compute[72184]: </disk>
Aug 01 17:01:44 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] No VIF found with MAC fa:16:3e:b3:39:b8, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2543b0a0-4261-4233-9973-a40ec2c5d469 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.574s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:45 user nova-compute[72184]: INFO nova.compute.manager [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Terminating instance
Aug 01 17:01:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-5d5ceeac-9a46-474b-8cbc-1b74d4cc4085 req-82ab5f6a-c69b-4483-9e26-690ba5a0db58 service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-vif-unplugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5d5ceeac-9a46-474b-8cbc-1b74d4cc4085 req-82ab5f6a-c69b-4483-9e26-690ba5a0db58 service nova] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5d5ceeac-9a46-474b-8cbc-1b74d4cc4085 req-82ab5f6a-c69b-4483-9e26-690ba5a0db58 service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5d5ceeac-9a46-474b-8cbc-1b74d4cc4085 req-82ab5f6a-c69b-4483-9e26-690ba5a0db58 service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-5d5ceeac-9a46-474b-8cbc-1b74d4cc4085 req-82ab5f6a-c69b-4483-9e26-690ba5a0db58 service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] No waiting events found dispatching network-vif-unplugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-5d5ceeac-9a46-474b-8cbc-1b74d4cc4085 req-82ab5f6a-c69b-4483-9e26-690ba5a0db58 service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-vif-unplugged-d978ca04-7ca5-425a-8566-365487478a5f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:01:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Instance destroyed successfully.
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.objects.instance [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lazy-loading 'resources' on Instance uuid af5bb465-0d7a-4768-b488-c7519b972afd {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1476730704',display_name='tempest-DeleteServersTestJSON-server-1476730704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1476730704',id=23,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3d6ef69825a4edfa90bbf9f6c4f7ed1',ramdisk_id='',reservation_id='r-icxe5yce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-90383099',owner_user_name='tempest-DeleteServersTestJSON-90383099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:59:45Z,user_data=None,user_id='8dc8d3f9b93c4eccb787aafafd861eef',uuid=af5bb465-0d7a-4768-b488-c7519b972afd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Converting VIF {"id": "d978ca04-7ca5-425a-8566-365487478a5f", "address": "fa:16:3e:b3:39:b8", "network": {"id": "56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-622284731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3d6ef69825a4edfa90bbf9f6c4f7ed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd978ca04-7c", "ovs_interfaceid": "d978ca04-7ca5-425a-8566-365487478a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_vif [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd978ca04-7c, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:46 user nova-compute[72184]: INFO os_vif [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:39:b8,bridge_name='br-int',has_traffic_filtering=True,id=d978ca04-7ca5-425a-8566-365487478a5f,network=Network(56b5ddcc-1f3a-4a5e-ab96-ec14b92095b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd978ca04-7c')
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muGcMNLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2a516-9f4c-46ec-a81b-8ef4441faac9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8003cbfe-117d-4702-9037-7e0d2deff415]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c (non-flash)
Aug 01 17:01:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:46 user nova-compute[72184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c (non-flash)
Aug 01 17:01:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301865ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c'): ({'sdg'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Removing single pathed devices sdg {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7a1a9-d8b5-4599-86bc-17cff5907b13]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea5e174-86e7-4d7b-8fc3-6671b2734385]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Flushing IO for device /dev/sdg {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb02440-4752-4da7-9e93-71f86a77b54c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0466de9d-344f-4d9f-a84d-addccd6f2d1b]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9195989f-e0f0-4053-a8fc-916bf7b1e5a0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add8747-3a88-4941-ae92-ddd36e96d6e9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260]
Aug 01 17:01:46 user nova-compute[72184]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5891de96-c6b8-4697-8781-d69bd056134c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4e89a-d58b-44ca-b22a-4a7b3dba5dd7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] <== disconnect_volume: return (364ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:01:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Deleting instance files /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd_del
Aug 01 17:01:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Deletion of /opt/stack/data/nova/instances/af5bb465-0d7a-4768-b488-c7519b972afd_del complete
Aug 01 17:01:47 user nova-compute[72184]: INFO nova.compute.manager [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:47 user nova-compute[72184]: INFO nova.compute.manager [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Terminating instance
Aug 01 17:01:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-37a81f83-39d0-444a-ad9e-aff08eca30b9 req-c4d31730-5bcb-45fb-84f6-c0eff8083a05 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-vif-unplugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-37a81f83-39d0-444a-ad9e-aff08eca30b9 req-c4d31730-5bcb-45fb-84f6-c0eff8083a05 service nova] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-37a81f83-39d0-444a-ad9e-aff08eca30b9 req-c4d31730-5bcb-45fb-84f6-c0eff8083a05 service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-37a81f83-39d0-444a-ad9e-aff08eca30b9 req-c4d31730-5bcb-45fb-84f6-c0eff8083a05 service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-37a81f83-39d0-444a-ad9e-aff08eca30b9 req-c4d31730-5bcb-45fb-84f6-c0eff8083a05 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] No waiting events found dispatching network-vif-unplugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-37a81f83-39d0-444a-ad9e-aff08eca30b9 req-c4d31730-5bcb-45fb-84f6-c0eff8083a05 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-vif-unplugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Instance destroyed successfully.
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'resources' on Instance uuid d4f11b06-6120-4515-9146-bfd02dad8f12 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1629104860',display_name='tempest-AttachVolumeNegativeTest-server-1629104860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1629104860',id=22,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH6PQf9SxweNogMczJv9O7WRAATgt4jHmjlST4t7HkG73K0TQuFRHYm+RQaU+Z6QT5dKdSVp9TB7rpKAXCUjXGMAJicdBzQ3vZ0pD+xECaytP0vV1cFdq/tDEJS9cq4xg==',key_name='tempest-keypair-423909565',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-32o8td0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=d4f11b06-6120-4515-9146-bfd02dad8f12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "address": "fa:16:3e:53:08:e3", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed94d1e-2f", "ovs_interfaceid": "1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG os_vif [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ed94d1e-2f, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:48 user nova-compute[72184]: INFO os_vif [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:08:e3,bridge_name='br-int',has_traffic_filtering=True,id=1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed94d1e-2f')
Aug 01 17:01:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Deleting instance files /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12_del
Aug 01 17:01:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Deletion of /opt/stack/data/nova/instances/d4f11b06-6120-4515-9146-bfd02dad8f12_del complete
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-e76cfc5d-566d-4fb0-be5a-42f7ddcb2157 req-2d9a079a-7915-49cc-aca3-58df760adc8f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e76cfc5d-566d-4fb0-be5a-42f7ddcb2157 req-2d9a079a-7915-49cc-aca3-58df760adc8f service nova] Acquiring lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e76cfc5d-566d-4fb0-be5a-42f7ddcb2157 req-2d9a079a-7915-49cc-aca3-58df760adc8f service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e76cfc5d-566d-4fb0-be5a-42f7ddcb2157 req-2d9a079a-7915-49cc-aca3-58df760adc8f service nova] Lock "af5bb465-0d7a-4768-b488-c7519b972afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-e76cfc5d-566d-4fb0-be5a-42f7ddcb2157 req-2d9a079a-7915-49cc-aca3-58df760adc8f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] No waiting events found dispatching network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:48 user nova-compute[72184]: WARNING nova.compute.manager [req-e76cfc5d-566d-4fb0-be5a-42f7ddcb2157 req-2d9a079a-7915-49cc-aca3-58df760adc8f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received unexpected event network-vif-plugged-d978ca04-7ca5-425a-8566-365487478a5f for instance with vm_state active and task_state deleting.
Aug 01 17:01:48 user nova-compute[72184]: INFO nova.compute.manager [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 17:01:48 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:48 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Took 1.29 seconds to deallocate network for instance.
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ef145af-0b74-4cd8-a436-ab0b1e03dfc9 req-572f977f-4f2a-4a54-bf96-9844ecab2a3f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Received event network-vif-deleted-d978ca04-7ca5-425a-8566-365487478a5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:48 user nova-compute[72184]: INFO nova.compute.manager [req-3ef145af-0b74-4cd8-a436-ab0b1e03dfc9 req-572f977f-4f2a-4a54-bf96-9844ecab2a3f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Neutron deleted interface d978ca04-7ca5-425a-8566-365487478a5f; detaching it from the instance and deleting it from the info cache
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-3ef145af-0b74-4cd8-a436-ab0b1e03dfc9 req-572f977f-4f2a-4a54-bf96-9844ecab2a3f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ef145af-0b74-4cd8-a436-ab0b1e03dfc9 req-572f977f-4f2a-4a54-bf96-9844ecab2a3f service nova] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Detach interface failed, port_id=d978ca04-7ca5-425a-8566-365487478a5f, reason: Instance af5bb465-0d7a-4768-b488-c7519b972afd could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:01:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:49 user nova-compute[72184]: INFO nova.compute.manager [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Took 1.08 seconds to detach 1 volumes for instance.
Aug 01 17:01:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:49 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b9c5044-fbb3-4c4b-86d2-79c7f06c157b req-a1cfeae7-369b-4311-94dc-2fb61c987374 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b9c5044-fbb3-4c4b-86d2-79c7f06c157b req-a1cfeae7-369b-4311-94dc-2fb61c987374 service nova] Acquiring lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b9c5044-fbb3-4c4b-86d2-79c7f06c157b req-a1cfeae7-369b-4311-94dc-2fb61c987374 service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b9c5044-fbb3-4c4b-86d2-79c7f06c157b req-a1cfeae7-369b-4311-94dc-2fb61c987374 service nova] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b9c5044-fbb3-4c4b-86d2-79c7f06c157b req-a1cfeae7-369b-4311-94dc-2fb61c987374 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] No waiting events found dispatching network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:50 user nova-compute[72184]: WARNING nova.compute.manager [req-2b9c5044-fbb3-4c4b-86d2-79c7f06c157b req-a1cfeae7-369b-4311-94dc-2fb61c987374 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received unexpected event network-vif-plugged-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde for instance with vm_state active and task_state deleting.
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.066s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:01:50 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Deleted allocations for instance af5bb465-0d7a-4768-b488-c7519b972afd
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:01:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Creating image(s)
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4c1efe4b-fbc1-4d56-92e3-19c2a04762c2 tempest-DeleteServersTestJSON-90383099 tempest-DeleteServersTestJSON-90383099-project-member] Lock "af5bb465-0d7a-4768-b488-c7519b972afd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.543s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Took 2.22 seconds to deallocate network for instance.
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.186s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk 1073741824" returned: 0 in 0.053s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.179s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Cannot resize image /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Ensure instance console log exists: /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Start _get_guest_xml network_info=[{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '1f9eac73-7fc3-46c6-8bbc-09a28465c7a3', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '99df3b11-5b8e-4d64-bd50-fd9a4a7f821f', 'attached_at': '', 'detached_at': '', 'volume_id': '702dfe35-44fa-40aa-a730-faaedfa48bd8', 'serial': '702dfe35-44fa-40aa-a730-faaedfa48bd8'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:01:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 17:01:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:51 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e219a9de-0afb-4804-bab3-f5c84ffb1dc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:01:51 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a48fc0-ab18-40ce-b2aa-8f8433cfbbd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8] added
Aug 01 17:01:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[79375114-1cc8-407b-a62f-92cd908606ae]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b9f4a-dbdc-4a9b-964e-176201cf335c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksADmbOf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksADmbOf" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38601837-807b-4342-8058-cb440ab179f5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksADmbOf'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec96c102-7b6d-4c27-a077-b500d2f3a1ea]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75926ee-ca6b-4df1-97fc-20e2e007d413]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.055s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Deleted allocations for instance d4f11b06-6120-4515-9146-bfd02dad8f12
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9242a04c-5a73-4947-8816-a27b73c18747 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "d4f11b06-6120-4515-9146-bfd02dad8f12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.543s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-bc8bcbc6-4753-4ae0-9a55-cd9df421c2a9 req-4d32807f-38d2-4bfa-a654-7cdd32b81b28 service nova] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Received event network-vif-deleted-1ed94d1e-2fb8-48eb-9b1c-24f2fec0dcde {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909297.5450583, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:52 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] VM Stopped (Lifecycle Event)
Aug 01 17:01:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d1c6e61f-06a7-4ccd-8463-ceadf538b0ea None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --login" returned: 0 in 1.102s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[646dd585-405d-45f5-b897-7072734dab9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]
Aug 01 17:01:52 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a3eaff-8d6f-4188-b1a8-61a9f8218782]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37792a9-5ce6-4165-b552-6fdfff6ffaa6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.523s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c0385f-1ed0-42e1-b951-f8d503b487c8]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.763s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== connect_volume: return (2765ms) {'type': 'block', 'scsi_wwn': '23635373932363461', 'path': '/dev/sdg'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635373932363461', 'path': '/dev/sdg'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:01:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:01:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7225MB free_disk=25.263076782226562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T16:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-163759626',display_name='tempest-ServerActionsTestOtherA-server-483945621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-163759626',id=20,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-smryrd3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=99df3b11-5b8e-4d64-bd50-fd9a4a7f821f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:01:53 user nova-compute[72184]:   <uuid>99df3b11-5b8e-4d64-bd50-fd9a4a7f821f</uuid>
Aug 01 17:01:53 user nova-compute[72184]:   <name>instance-00000014</name>
Aug 01 17:01:53 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:01:53 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:01:53 user nova-compute[72184]:   <metadata>
Aug 01 17:01:53 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:01:53 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:01:53 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherA-server-483945621</nova:name>
Aug 01 17:01:53 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:01:51</nova:creationTime>
Aug 01 17:01:53 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:01:53 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:01:53 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:01:53 user nova-compute[72184]:       <nova:owner>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:user uuid="09d472678ed94cb7ab09de7d72128f84">tempest-ServerActionsTestOtherA-2143698002-project-member</nova:user>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:project uuid="3ef0982d76ca40a48b457e0797d6837b">tempest-ServerActionsTestOtherA-2143698002</nova:project>
Aug 01 17:01:53 user nova-compute[72184]:       </nova:owner>
Aug 01 17:01:53 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:01:53 user nova-compute[72184]:       <nova:ports>
Aug 01 17:01:53 user nova-compute[72184]:         <nova:port uuid="d8c311e0-0221-4d18-8579-f30e351d6ad5">
Aug 01 17:01:53 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:01:53 user nova-compute[72184]:         </nova:port>
Aug 01 17:01:53 user nova-compute[72184]:       </nova:ports>
Aug 01 17:01:53 user nova-compute[72184]:     </nova:instance>
Aug 01 17:01:53 user nova-compute[72184]:   </metadata>
Aug 01 17:01:53 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:01:53 user nova-compute[72184]:     <system>
Aug 01 17:01:53 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:01:53 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:01:53 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:01:53 user nova-compute[72184]:       <entry name="serial">99df3b11-5b8e-4d64-bd50-fd9a4a7f821f</entry>
Aug 01 17:01:53 user nova-compute[72184]:       <entry name="uuid">99df3b11-5b8e-4d64-bd50-fd9a4a7f821f</entry>
Aug 01 17:01:53 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:01:53 user nova-compute[72184]:     </system>
Aug 01 17:01:53 user nova-compute[72184]:   </sysinfo>
Aug 01 17:01:53 user nova-compute[72184]:   <os>
Aug 01 17:01:53 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:01:53 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:01:53 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:01:53 user nova-compute[72184]:   </os>
Aug 01 17:01:53 user nova-compute[72184]:   <features>
Aug 01 17:01:53 user nova-compute[72184]:     <acpi/>
Aug 01 17:01:53 user nova-compute[72184]:     <apic/>
Aug 01 17:01:53 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:01:53 user nova-compute[72184]:   </features>
Aug 01 17:01:53 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:01:53 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:01:53 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:01:53 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:01:53 user nova-compute[72184]:   </clock>
Aug 01 17:01:53 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:01:53 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:01:53 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:01:53 user nova-compute[72184]:   </cpu>
Aug 01 17:01:53 user nova-compute[72184]:   <devices>
Aug 01 17:01:53 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:01:53 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:01:53 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk"/>
Aug 01 17:01:53 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:01:53 user nova-compute[72184]:     </disk>
Aug 01 17:01:53 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:01:53 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:53 user nova-compute[72184]:       <source dev="/dev/sdg"/>
Aug 01 17:01:53 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:01:53 user nova-compute[72184]:       <serial>702dfe35-44fa-40aa-a730-faaedfa48bd8</serial>
Aug 01 17:01:53 user nova-compute[72184]:     </disk>
Aug 01 17:01:53 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:01:53 user nova-compute[72184]:       <mac address="fa:16:3e:f4:23:78"/>
Aug 01 17:01:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:53 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:01:53 user nova-compute[72184]:       <target dev="tapd8c311e0-02"/>
Aug 01 17:01:53 user nova-compute[72184]:     </interface>
Aug 01 17:01:53 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:01:53 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/console.log" append="off"/>
Aug 01 17:01:53 user nova-compute[72184]:     </serial>
Aug 01 17:01:53 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:01:53 user nova-compute[72184]:     <video>
Aug 01 17:01:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:01:53 user nova-compute[72184]:     </video>
Aug 01 17:01:53 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:01:53 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:01:53 user nova-compute[72184]:     </rng>
Aug 01 17:01:53 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:01:53 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:01:53 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:01:53 user nova-compute[72184]:     </memballoon>
Aug 01 17:01:53 user nova-compute[72184]:   </devices>
Aug 01 17:01:53 user nova-compute[72184]: </domain>
Aug 01 17:01:53 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T16:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-163759626',display_name='tempest-ServerActionsTestOtherA-server-483945621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-163759626',id=20,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-smryrd3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=99df3b11-5b8e-4d64-bd50-fd9a4a7f821f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG os_vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c311e0-02, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c311e0-02, col_values=(('external_ids', {'iface-id': 'd8c311e0-0221-4d18-8579-f30e351d6ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:23:78', 'vm-uuid': '99df3b11-5b8e-4d64-bd50-fd9a4a7f821f'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:54 user nova-compute[72184]: INFO os_vif [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02')
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Applying migration context for instance 1ba84814-1a19-453e-9482-3fae91ae857d as it has an incoming, in-progress migration 1849ac1c-0c55-4d44-8f95-28e2654e4530. Migration status is finished {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 17:01:54 user nova-compute[72184]: INFO nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating resource usage from migration 1849ac1c-0c55-4d44-8f95-28e2654e4530
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Migration 1849ac1c-0c55-4d44-8f95-28e2654e4530 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No VIF found with MAC fa:16:3e:f4:23:78, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:01:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-bc442742-25ea-4fd1-aafd-4d3cab27766f req-7a8e7bbc-6dcd-4875-bbdb-c1409c6bfff4 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bc442742-25ea-4fd1-aafd-4d3cab27766f req-7a8e7bbc-6dcd-4875-bbdb-c1409c6bfff4 service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bc442742-25ea-4fd1-aafd-4d3cab27766f req-7a8e7bbc-6dcd-4875-bbdb-c1409c6bfff4 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bc442742-25ea-4fd1-aafd-4d3cab27766f req-7a8e7bbc-6dcd-4875-bbdb-c1409c6bfff4 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-bc442742-25ea-4fd1-aafd-4d3cab27766f req-7a8e7bbc-6dcd-4875-bbdb-c1409c6bfff4 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:55 user nova-compute[72184]: WARNING nova.compute.manager [req-bc442742-25ea-4fd1-aafd-4d3cab27766f req-7a8e7bbc-6dcd-4875-bbdb-c1409c6bfff4 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 17:01:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing instance network info cache due to event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.compute.manager [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Detaching volume 3ef66bd3-ecae-45f2-84f2-99e3ceedbea9
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.virt.block_device [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Attempting to driver detach volume 3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 from mountpoint /dev/vdb
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Attempting to detach device vdb from instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:01:57 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:57 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:01:57 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:01:57 user nova-compute[72184]:   <serial>3ef66bd3-ecae-45f2-84f2-99e3ceedbea9</serial>
Aug 01 17:01:57 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:01:57 user nova-compute[72184]: </disk>
Aug 01 17:01:57 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully detached device vdb from instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 from the persistent domain config.
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:01:57 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:01:57 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:01:57 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:01:57 user nova-compute[72184]:   <serial>3ef66bd3-ecae-45f2-84f2-99e3ceedbea9</serial>
Aug 01 17:01:57 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:01:57 user nova-compute[72184]: </disk>
Aug 01 17:01:57 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updating instance_info_cache with network_info: [{"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-a8b17402-c090-4e22-8ca7-06df5361d20c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updated VIF entry in instance network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b502ec4e-6c91-43cc-9810-21e1dda06790 req-321c8489-0db6-497f-ac95-3367b10d539e service nova] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909317.7780304, 64db4084-3f8d-4f1a-87f7-99a86671fdd1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully detached device vdb from instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 from the live domain config.
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdFOAswZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:01:57 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909317.8120124, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] VM Resumed (Lifecycle Event)
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eae18a-c643-46bf-b6c5-10e264bb070d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance spawned successfully.
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2079b-1844-4638-b5af-b3eea5cf40fb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:01:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30182e6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909317.8132873, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] VM Started (Lifecycle Event)
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c951ece-ec7d-4dbe-9645-d2f08600f3d8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d187020-610f-4890-96e9-123e196faeb6]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-ce3b11e7-7b04-407a-b510-3d64c485ab3c req-5bc0d25c-6329-4601-8ac7-92f1aeda13c7 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ce3b11e7-7b04-407a-b510-3d64c485ab3c req-5bc0d25c-6329-4601-8ac7-92f1aeda13c7 service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ce3b11e7-7b04-407a-b510-3d64c485ab3c req-5bc0d25c-6329-4601-8ac7-92f1aeda13c7 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ce3b11e7-7b04-407a-b510-3d64c485ab3c req-5bc0d25c-6329-4601-8ac7-92f1aeda13c7 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-ce3b11e7-7b04-407a-b510-3d64c485ab3c req-5bc0d25c-6329-4601-8ac7-92f1aeda13c7 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:01:57 user nova-compute[72184]: WARNING nova.compute.manager [req-ce3b11e7-7b04-407a-b510-3d64c485ab3c req-5bc0d25c-6329-4601-8ac7-92f1aeda13c7 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0822c4e1-f7b1-4812-9009-4eaa1ca62f63]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:01:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a883313f-2b59-4a25-bd0c-7d9eb2cfb7dc]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a479d-92c3-4140-a054-810d86f00055]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72184) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing instance network info cache due to event network-changed-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] Acquiring lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] Acquired lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Refreshing network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ae181c2d-9d93-445d-ab88-0778bfde735d tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a52199-9ca6-485b-8fb2-889efed72863]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260]
Aug 01 17:01:58 user nova-compute[72184]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9, portal: 172.16.0.220,3260] successful.
Aug 01 17:01:58 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ef66bd3-ecae-45f2-84f2-99e3ceedbea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a590e-e820-477b-9b5e-d605c77bd619]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== disconnect_volume: return (382ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updated VIF entry in instance network info cache for port 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [{"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-550a8583-60d4-4a2f-94f2-d819d6cfd085 req-59160d5b-c352-48d8-bede-6b6c8f5de05f service nova] Releasing lock "refresh_cache-64db4084-3f8d-4f1a-87f7-99a86671fdd1" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:58 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:01:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:01:59 user nova-compute[72184]: DEBUG nova.objects.instance [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'flavor' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:01:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96e8ec6c-36e1-45a3-8fb9-e7aa18c7aeae tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.047s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:02:01 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909306.5196927, af5bb465-0d7a-4768-b488-c7519b972afd => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:01 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] VM Stopped (Lifecycle Event)
Aug 01 17:02:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-988738ed-4a58-4376-95ca-7a592ae38184 None None] [instance: af5bb465-0d7a-4768-b488-c7519b972afd] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:03 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909308.0995986, d4f11b06-6120-4515-9146-bfd02dad8f12 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:03 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] VM Stopped (Lifecycle Event)
Aug 01 17:02:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-de9ecbce-ba0a-4df8-907c-3ed75f487f84 None None] [instance: d4f11b06-6120-4515-9146-bfd02dad8f12] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:02:09 user nova-compute[72184]: INFO nova.compute.claims [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Claim successful on node user
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:02:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.policy [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe75ee370f04c89af06c3eb592c585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff6a0fda580e4e6a9ea4e26d30df9e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:02:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Creating image(s)
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "/opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "/opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk 1073741824" returned: 0 in 0.069s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Successfully created port: dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Cannot resize image /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lazy-loading 'migration_context' on Instance uuid e9785915-eb53-4bc0-ab2f-b0fbe9633015 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Ensure instance console log exists: /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Successfully updated port: dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "refresh_cache-e9785915-eb53-4bc0-ab2f-b0fbe9633015" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquired lock "refresh_cache-e9785915-eb53-4bc0-ab2f-b0fbe9633015" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-changed-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Refreshing instance network info cache due to event network-changed-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:02:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] Acquiring lock "refresh_cache-e9785915-eb53-4bc0-ab2f-b0fbe9633015" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Updating instance_info_cache with network_info: [{"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Releasing lock "refresh_cache-e9785915-eb53-4bc0-ab2f-b0fbe9633015" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Instance network_info: |[{"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] Acquired lock "refresh_cache-e9785915-eb53-4bc0-ab2f-b0fbe9633015" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Refreshing network info cache for port dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Start _get_guest_xml network_info=[{"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:02:12 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:12 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-299803923',display_name='tempest-VolumesActionsTest-instance-299803923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-299803923',id=27,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff6a0fda580e4e6a9ea4e26d30df9e67',ramdisk_id='',reservation_id='r-io0dznxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-197584980',owner_user_name='tempest-VolumesActionsTest-197584980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:02:10Z,user_data=None,user_id='8fe75ee370f04c89af06c3eb592c585a',uuid=e9785915-eb53-4bc0-ab2f-b0fbe9633015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converting VIF {"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lazy-loading 'pci_devices' on Instance uuid e9785915-eb53-4bc0-ab2f-b0fbe9633015 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:02:12 user nova-compute[72184]:   <uuid>e9785915-eb53-4bc0-ab2f-b0fbe9633015</uuid>
Aug 01 17:02:12 user nova-compute[72184]:   <name>instance-0000001b</name>
Aug 01 17:02:12 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:02:12 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:02:12 user nova-compute[72184]:   <metadata>
Aug 01 17:02:12 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:02:12 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:02:12 user nova-compute[72184]:       <nova:name>tempest-VolumesActionsTest-instance-299803923</nova:name>
Aug 01 17:02:12 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:02:12</nova:creationTime>
Aug 01 17:02:12 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:02:12 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:02:12 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:02:12 user nova-compute[72184]:       <nova:owner>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:user uuid="8fe75ee370f04c89af06c3eb592c585a">tempest-VolumesActionsTest-197584980-project-member</nova:user>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:project uuid="ff6a0fda580e4e6a9ea4e26d30df9e67">tempest-VolumesActionsTest-197584980</nova:project>
Aug 01 17:02:12 user nova-compute[72184]:       </nova:owner>
Aug 01 17:02:12 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:02:12 user nova-compute[72184]:       <nova:ports>
Aug 01 17:02:12 user nova-compute[72184]:         <nova:port uuid="dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5">
Aug 01 17:02:12 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 17:02:12 user nova-compute[72184]:         </nova:port>
Aug 01 17:02:12 user nova-compute[72184]:       </nova:ports>
Aug 01 17:02:12 user nova-compute[72184]:     </nova:instance>
Aug 01 17:02:12 user nova-compute[72184]:   </metadata>
Aug 01 17:02:12 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:02:12 user nova-compute[72184]:     <system>
Aug 01 17:02:12 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:02:12 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:02:12 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:02:12 user nova-compute[72184]:       <entry name="serial">e9785915-eb53-4bc0-ab2f-b0fbe9633015</entry>
Aug 01 17:02:12 user nova-compute[72184]:       <entry name="uuid">e9785915-eb53-4bc0-ab2f-b0fbe9633015</entry>
Aug 01 17:02:12 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:02:12 user nova-compute[72184]:     </system>
Aug 01 17:02:12 user nova-compute[72184]:   </sysinfo>
Aug 01 17:02:12 user nova-compute[72184]:   <os>
Aug 01 17:02:12 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:02:12 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:02:12 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:02:12 user nova-compute[72184]:   </os>
Aug 01 17:02:12 user nova-compute[72184]:   <features>
Aug 01 17:02:12 user nova-compute[72184]:     <acpi/>
Aug 01 17:02:12 user nova-compute[72184]:     <apic/>
Aug 01 17:02:12 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:02:12 user nova-compute[72184]:   </features>
Aug 01 17:02:12 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:02:12 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:02:12 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:02:12 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:02:12 user nova-compute[72184]:   </clock>
Aug 01 17:02:12 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:02:12 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:02:12 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:02:12 user nova-compute[72184]:   </cpu>
Aug 01 17:02:12 user nova-compute[72184]:   <devices>
Aug 01 17:02:12 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:02:12 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:02:12 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk"/>
Aug 01 17:02:12 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:02:12 user nova-compute[72184]:     </disk>
Aug 01 17:02:12 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:02:12 user nova-compute[72184]:       <mac address="fa:16:3e:e4:dd:9a"/>
Aug 01 17:02:12 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:02:12 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:02:12 user nova-compute[72184]:       <target dev="tapdbc9dd16-ce"/>
Aug 01 17:02:12 user nova-compute[72184]:     </interface>
Aug 01 17:02:12 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:02:12 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/console.log" append="off"/>
Aug 01 17:02:12 user nova-compute[72184]:     </serial>
Aug 01 17:02:12 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:02:12 user nova-compute[72184]:     <video>
Aug 01 17:02:12 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:02:12 user nova-compute[72184]:     </video>
Aug 01 17:02:12 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:02:12 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:02:12 user nova-compute[72184]:     </rng>
Aug 01 17:02:12 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:02:12 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:02:12 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:02:12 user nova-compute[72184]:     </memballoon>
Aug 01 17:02:12 user nova-compute[72184]:   </devices>
Aug 01 17:02:12 user nova-compute[72184]: </domain>
Aug 01 17:02:12 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-299803923',display_name='tempest-VolumesActionsTest-instance-299803923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-299803923',id=27,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff6a0fda580e4e6a9ea4e26d30df9e67',ramdisk_id='',reservation_id='r-io0dznxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-197584980',owner_user_name='tempest-VolumesActionsTest-197584980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:02:10Z,user_data=None,user_id='8fe75ee370f04c89af06c3eb592c585a',uuid=e9785915-eb53-4bc0-ab2f-b0fbe9633015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converting VIF {"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG os_vif [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbc9dd16-ce, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbc9dd16-ce, col_values=(('external_ids', {'iface-id': 'dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:dd:9a', 'vm-uuid': 'e9785915-eb53-4bc0-ab2f-b0fbe9633015'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:12 user nova-compute[72184]: INFO os_vif [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce')
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] No VIF found with MAC fa:16:3e:e4:dd:9a, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Updated VIF entry in instance network info cache for port dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG nova.network.neutron [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Updating instance_info_cache with network_info: [{"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6a7fc0ec-decb-49b8-ae3c-89b7d757a4d3 req-7562df85-aeee-4744-b376-4b3e5e2a061d service nova] Releasing lock "refresh_cache-e9785915-eb53-4bc0-ab2f-b0fbe9633015" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-e799fc01-c599-47e2-966a-27cc130a1060 req-03664d55-d0cb-43f5-9808-d4d16ac9a1fc service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e799fc01-c599-47e2-966a-27cc130a1060 req-03664d55-d0cb-43f5-9808-d4d16ac9a1fc service nova] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e799fc01-c599-47e2-966a-27cc130a1060 req-03664d55-d0cb-43f5-9808-d4d16ac9a1fc service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e799fc01-c599-47e2-966a-27cc130a1060 req-03664d55-d0cb-43f5-9808-d4d16ac9a1fc service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-e799fc01-c599-47e2-966a-27cc130a1060 req-03664d55-d0cb-43f5-9808-d4d16ac9a1fc service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] No waiting events found dispatching network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:14 user nova-compute[72184]: WARNING nova.compute.manager [req-e799fc01-c599-47e2-966a-27cc130a1060 req-03664d55-d0cb-43f5-9808-d4d16ac9a1fc service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received unexpected event network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 for instance with vm_state building and task_state spawning.
Aug 01 17:02:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909336.0008416, e9785915-eb53-4bc0-ab2f-b0fbe9633015 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] VM Resumed (Lifecycle Event)
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Instance spawned successfully.
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909336.0028076, e9785915-eb53-4bc0-ab2f-b0fbe9633015 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] VM Started (Lifecycle Event)
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:16 user nova-compute[72184]: INFO nova.compute.manager [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Took 6.44 seconds to build instance.
Aug 01 17:02:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ed7eeea-fae3-4549-b22d-4ee1d2a25d94 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.539s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-60d38900-54fa-4085-a51f-5ed6b1a43369 req-a7118848-14ff-44e1-8e0e-db7f29c4953c service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60d38900-54fa-4085-a51f-5ed6b1a43369 req-a7118848-14ff-44e1-8e0e-db7f29c4953c service nova] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60d38900-54fa-4085-a51f-5ed6b1a43369 req-a7118848-14ff-44e1-8e0e-db7f29c4953c service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60d38900-54fa-4085-a51f-5ed6b1a43369 req-a7118848-14ff-44e1-8e0e-db7f29c4953c service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-60d38900-54fa-4085-a51f-5ed6b1a43369 req-a7118848-14ff-44e1-8e0e-db7f29c4953c service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] No waiting events found dispatching network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:16 user nova-compute[72184]: WARNING nova.compute.manager [req-60d38900-54fa-4085-a51f-5ed6b1a43369 req-a7118848-14ff-44e1-8e0e-db7f29c4953c service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received unexpected event network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 for instance with vm_state active and task_state None.
Aug 01 17:02:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing instance network info cache due to event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG nova.objects.instance [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'flavor' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updated VIF entry in instance network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8f7efd40-75fc-422e-a19f-d2e906d94323 req-855fc008-4be3-44fa-8d23-2d7c8f85fd2c service nova] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:19 user nova-compute[72184]: INFO nova.compute.manager [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Attaching volume ecca2701-652e-4e52-8429-66a371c105f6 to /dev/vdb
Aug 01 17:02:19 user nova-compute[72184]: DEBUG os_brick.utils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b68bb0-1c44-4565-8c46-e8ce266ec38b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121bb6c-7526-424f-8dab-6e9e91c1209e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0855088d-c001-4fbd-be6e-5b1af87234b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055d759-654c-431f-a4e3-0b93e8e97e8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:02:19 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:02:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff48d0-0bba-4edb-80f2-332326591909]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG os_brick.utils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:19 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating existing volume attachment record: 24d979a5-a5b9-4204-8ba4-5ec2560ec539 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:21 user nova-compute[72184]: INFO nova.compute.manager [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] instance snapshotting
Aug 01 17:02:21 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Beginning live snapshot process
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json -f qcow2" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp72o5bzbh/c5207771250d48a489a00c33b00f0069.delta 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp72o5bzbh/c5207771250d48a489a00c33b00f0069.delta 1073741824" returned: 0 in 0.052s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:22 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 17:02:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 17:02:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] COPY block job progress, current cursor: 21692416 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 17:02:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 17:02:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 17:02:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:23 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:02:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp72o5bzbh/c5207771250d48a489a00c33b00f0069.delta /opt/stack/data/nova/instances/snapshots/tmp72o5bzbh/c5207771250d48a489a00c33b00f0069 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp72o5bzbh/c5207771250d48a489a00c33b00f0069.delta /opt/stack/data/nova/instances/snapshots/tmp72o5bzbh/c5207771250d48a489a00c33b00f0069" returned: 0 in 0.694s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:24 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Snapshot extracted, beginning image upload
Aug 01 17:02:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Snapshot image upload complete
Aug 01 17:02:27 user nova-compute[72184]: INFO nova.compute.manager [None req-1c94bdaa-5af1-4d34-ba5d-6d0161ae932a tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Took 6.16 seconds to snapshot the instance on the hypervisor.
Aug 01 17:02:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJCEgzuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:32 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:02:32 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:02:32 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f722cced-c788-4c8a-a70c-c8ccb88197df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:02:32 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1af0af3-8c5d-4490-b30e-2d3fa4bb58c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6] added
Aug 01 17:02:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8391cb5-04d8-4280-9616-a3e61d7891e7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44425daa-723b-4563-b819-11d5738f93c4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJCEgzuK {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJCEgzuK" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ce485-b6d5-4121-8738-106cd0e168da]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WJCEgzuK'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1dfc61-bc97-4738-8c9b-3a7417bb43fc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde2111-8e98-48b4-a591-9646816b8e81]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)
Aug 01 17:02:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:32 user nova-compute[72184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)
Aug 01 17:02:32 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:02:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bc6ca8-dbdb-400b-955f-3d9c3b5fd4c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260]
Aug 01 17:02:33 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260] successful.
Aug 01 17:02:33 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[323dd335-c52a-4917-a5c5-e53f070dd313]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80194b6-c5f1-4f52-b6b0-6c4c50f473f5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)
Aug 01 17:02:33 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:33 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] HCTL ('39', '-', '-', 0) found on session 29 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e572d43-eb87-477f-83ee-d368ed3db9ad]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching for a device in session 29 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJCEgzuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:02:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26234626534393538', 'path': '/dev/sdh'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234626534393538', 'path': '/dev/sdh'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'flavor' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:02:34 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:02:34 user nova-compute[72184]:   <source dev="/dev/sdh"/>
Aug 01 17:02:34 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:02:34 user nova-compute[72184]:   <serial>ecca2701-652e-4e52-8429-66a371c105f6</serial>
Aug 01 17:02:34 user nova-compute[72184]: </disk>
Aug 01 17:02:34 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:91:d0:8d, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:02:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4cdacbf8-0f1a-4b6d-8619-280bcbf85243 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.719s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:35 user nova-compute[72184]: INFO nova.compute.manager [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Rescuing
Aug 01 17:02:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-50b643af-b41f-4e5a-bc97-6cec7e56f8b7 req-e0333a20-5321-49bd-ad41-185a53aedecf service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-50b643af-b41f-4e5a-bc97-6cec7e56f8b7 req-e0333a20-5321-49bd-ad41-185a53aedecf service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-50b643af-b41f-4e5a-bc97-6cec7e56f8b7 req-e0333a20-5321-49bd-ad41-185a53aedecf service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-50b643af-b41f-4e5a-bc97-6cec7e56f8b7 req-e0333a20-5321-49bd-ad41-185a53aedecf service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-50b643af-b41f-4e5a-bc97-6cec7e56f8b7 req-e0333a20-5321-49bd-ad41-185a53aedecf service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:36 user nova-compute[72184]: WARNING nova.compute.manager [req-50b643af-b41f-4e5a-bc97-6cec7e56f8b7 req-e0333a20-5321-49bd-ad41-185a53aedecf service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state active and task_state rescuing.
Aug 01 17:02:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance destroyed successfully.
Aug 01 17:02:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Attempting rescue
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 17:02:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Creating image(s)
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue" returned: 0 in 0.057s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'migration_context' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Start _get_guest_xml network_info=[{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:91:d0:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'resources' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'numa_topology' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:37 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:37 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-461366033',display_name='tempest-ServerRescueNegativeTestJSON-server-461366033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-461366033',id=24,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP+bS68qWQCoGZnJjxF1jc58ptndhJiEmnwylfKG9P48v8l3rYgjYPJ1jEFvOMPHwVFjb5aOT+5fNYfzwD56nXkiweV3qOUb8Xwz5GX5QsXqzSaIJRLyGtlCqA+ledbvA==',key_name='tempest-keypair-1369140919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-uyzjywnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=90809a35-7659-492d-a605-e3b40e161bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:91:d0:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "vif_mac": "fa:16:3e:91:d0:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'pci_devices' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:02:37 user nova-compute[72184]:   <uuid>90809a35-7659-492d-a605-e3b40e161bbf</uuid>
Aug 01 17:02:37 user nova-compute[72184]:   <name>instance-00000018</name>
Aug 01 17:02:37 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:02:37 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:02:37 user nova-compute[72184]:   <metadata>
Aug 01 17:02:37 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:02:37 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:02:37 user nova-compute[72184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-461366033</nova:name>
Aug 01 17:02:37 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:02:37</nova:creationTime>
Aug 01 17:02:37 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:02:37 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:02:37 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:02:37 user nova-compute[72184]:       <nova:owner>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:user uuid="b0e33dc89b5744c2ad3c0d86f759c9c3">tempest-ServerRescueNegativeTestJSON-353659352-project-member</nova:user>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:project uuid="e0a62e50ced845abbadbe12339265fdc">tempest-ServerRescueNegativeTestJSON-353659352</nova:project>
Aug 01 17:02:37 user nova-compute[72184]:       </nova:owner>
Aug 01 17:02:37 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:02:37 user nova-compute[72184]:       <nova:ports>
Aug 01 17:02:37 user nova-compute[72184]:         <nova:port uuid="e026812f-e506-4c8f-b5ac-58f30b5c82b4">
Aug 01 17:02:37 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 17:02:37 user nova-compute[72184]:         </nova:port>
Aug 01 17:02:37 user nova-compute[72184]:       </nova:ports>
Aug 01 17:02:37 user nova-compute[72184]:     </nova:instance>
Aug 01 17:02:37 user nova-compute[72184]:   </metadata>
Aug 01 17:02:37 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:02:37 user nova-compute[72184]:     <system>
Aug 01 17:02:37 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:02:37 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:02:37 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:02:37 user nova-compute[72184]:       <entry name="serial">90809a35-7659-492d-a605-e3b40e161bbf</entry>
Aug 01 17:02:37 user nova-compute[72184]:       <entry name="uuid">90809a35-7659-492d-a605-e3b40e161bbf</entry>
Aug 01 17:02:37 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:02:37 user nova-compute[72184]:     </system>
Aug 01 17:02:37 user nova-compute[72184]:   </sysinfo>
Aug 01 17:02:37 user nova-compute[72184]:   <os>
Aug 01 17:02:37 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:02:37 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:02:37 user nova-compute[72184]:   </os>
Aug 01 17:02:37 user nova-compute[72184]:   <features>
Aug 01 17:02:37 user nova-compute[72184]:     <acpi/>
Aug 01 17:02:37 user nova-compute[72184]:     <apic/>
Aug 01 17:02:37 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:02:37 user nova-compute[72184]:   </features>
Aug 01 17:02:37 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:02:37 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:02:37 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:02:37 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:02:37 user nova-compute[72184]:   </clock>
Aug 01 17:02:37 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:02:37 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:02:37 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:02:37 user nova-compute[72184]:   </cpu>
Aug 01 17:02:37 user nova-compute[72184]:   <devices>
Aug 01 17:02:37 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:02:37 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:02:37 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue"/>
Aug 01 17:02:37 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:02:37 user nova-compute[72184]:     </disk>
Aug 01 17:02:37 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:02:37 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:02:37 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk"/>
Aug 01 17:02:37 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:02:37 user nova-compute[72184]:     </disk>
Aug 01 17:02:37 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:02:37 user nova-compute[72184]:       <mac address="fa:16:3e:91:d0:8d"/>
Aug 01 17:02:37 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:02:37 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:02:37 user nova-compute[72184]:       <target dev="tape026812f-e5"/>
Aug 01 17:02:37 user nova-compute[72184]:     </interface>
Aug 01 17:02:37 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:02:37 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/console.log" append="off"/>
Aug 01 17:02:37 user nova-compute[72184]:     </serial>
Aug 01 17:02:37 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:02:37 user nova-compute[72184]:     <video>
Aug 01 17:02:37 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:02:37 user nova-compute[72184]:     </video>
Aug 01 17:02:37 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:02:37 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:02:37 user nova-compute[72184]:     </rng>
Aug 01 17:02:37 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:02:37 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:02:37 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:02:37 user nova-compute[72184]:     </memballoon>
Aug 01 17:02:37 user nova-compute[72184]:   </devices>
Aug 01 17:02:37 user nova-compute[72184]: </domain>
Aug 01 17:02:37 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:02:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance destroyed successfully.
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:02:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] No VIF found with MAC fa:16:3e:91:d0:8d, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:02:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-c2c2514d-ec08-4087-8d7f-203f8a1498eb req-a60e5f80-717a-4d5b-ae17-730b90ed776b service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c2c2514d-ec08-4087-8d7f-203f8a1498eb req-a60e5f80-717a-4d5b-ae17-730b90ed776b service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c2c2514d-ec08-4087-8d7f-203f8a1498eb req-a60e5f80-717a-4d5b-ae17-730b90ed776b service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c2c2514d-ec08-4087-8d7f-203f8a1498eb req-a60e5f80-717a-4d5b-ae17-730b90ed776b service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-c2c2514d-ec08-4087-8d7f-203f8a1498eb req-a60e5f80-717a-4d5b-ae17-730b90ed776b service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:38 user nova-compute[72184]: WARNING nova.compute.manager [req-c2c2514d-ec08-4087-8d7f-203f8a1498eb req-a60e5f80-717a-4d5b-ae17-730b90ed776b service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state active and task_state rescuing.
Aug 01 17:02:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:40 user nova-compute[72184]: WARNING nova.compute.manager [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state active and task_state rescuing.
Aug 01 17:02:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:40 user nova-compute[72184]: WARNING nova.compute.manager [req-15843f04-80a1-43de-ab75-d2d6213b588b req-6b6ac04c-1270-4366-8200-2c9098abd1dc service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state active and task_state rescuing.
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 90809a35-7659-492d-a605-e3b40e161bbf due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909361.5601292, 90809a35-7659-492d-a605-e3b40e161bbf => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Resumed (Lifecycle Event)
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b06cf45f-1b79-45b1-afa3-cc6d7ddc171d tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:02:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909361.564207, 90809a35-7659-492d-a605-e3b40e161bbf => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:41 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Started (Lifecycle Event)
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:02:42 user nova-compute[72184]: INFO nova.compute.claims [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Claim successful on node user
Aug 01 17:02:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:02:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:02:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Creating image(s)
Aug 01 17:02:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "/opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "/opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG nova.policy [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '154bf9bc1d904d55a86bd739a2f65677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7490e7fdbe46cd8618b6431046108b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:02:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.217s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.202s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk 1073741824" returned: 0 in 0.065s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.191s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Cannot resize image /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'migration_context' on Instance uuid e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Ensure instance console log exists: /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Successfully created port: b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:02:47 user nova-compute[72184]: DEBUG nova.network.neutron [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Port fc02a82f-c678-49e6-8196-5213ef90e225 binding to destination host user is already ACTIVE {{(pid=72184) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 17:02:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:47 user nova-compute[72184]: DEBUG nova.network.neutron [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:02:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-changed-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing instance network info cache due to event network-changed-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] Acquiring lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] Acquired lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Refreshing network info cache for port 5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Successfully updated port: b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquired lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updated VIF entry in instance network info cache for port 5cacaa56-cc77-4ea8-943d-17ca5e93a7dd. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-870adca2-da81-4667-963c-1290d42b1710 req-20218fc0-a775-48e2-9f3a-6217eab1c42c service nova] Releasing lock "refresh_cache-6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updating instance_info_cache with network_info: [{"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Releasing lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Instance network_info: |[{"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Start _get_guest_xml network_info=[{"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:02:49 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:49 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-380742335',display_name='tempest-AttachVolumeNegativeTest-server-380742335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-380742335',id=28,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU6ecdTmg1BGTpYLeejXYLZ6riHTbK9JkE3ZnchwVn8WkWWAXfHnn5vJJdXgU6MSAHCYn63KfMUJAbrg2gItIGUt/D3qH6Qel4BR1DUO+ldC3owMp0Isbfkg2EkuhAs0w==',key_name='tempest-keypair-2125851177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-88w6cic4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=e319b28e-a026-4491-b499-a656711f4c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'pci_devices' on Instance uuid e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:02:49 user nova-compute[72184]:   <uuid>e319b28e-a026-4491-b499-a656711f4c52</uuid>
Aug 01 17:02:49 user nova-compute[72184]:   <name>instance-0000001c</name>
Aug 01 17:02:49 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:02:49 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:02:49 user nova-compute[72184]:   <metadata>
Aug 01 17:02:49 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:02:49 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:02:49 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-380742335</nova:name>
Aug 01 17:02:49 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:02:49</nova:creationTime>
Aug 01 17:02:49 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:02:49 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:02:49 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:02:49 user nova-compute[72184]:       <nova:owner>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:user uuid="154bf9bc1d904d55a86bd739a2f65677">tempest-AttachVolumeNegativeTest-1778743204-project-member</nova:user>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:project uuid="9b7490e7fdbe46cd8618b6431046108b">tempest-AttachVolumeNegativeTest-1778743204</nova:project>
Aug 01 17:02:49 user nova-compute[72184]:       </nova:owner>
Aug 01 17:02:49 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:02:49 user nova-compute[72184]:       <nova:ports>
Aug 01 17:02:49 user nova-compute[72184]:         <nova:port uuid="b15c3c84-1c87-4a8b-a3c5-57b349e24d79">
Aug 01 17:02:49 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 17:02:49 user nova-compute[72184]:         </nova:port>
Aug 01 17:02:49 user nova-compute[72184]:       </nova:ports>
Aug 01 17:02:49 user nova-compute[72184]:     </nova:instance>
Aug 01 17:02:49 user nova-compute[72184]:   </metadata>
Aug 01 17:02:49 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:02:49 user nova-compute[72184]:     <system>
Aug 01 17:02:49 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:02:49 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:02:49 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:02:49 user nova-compute[72184]:       <entry name="serial">e319b28e-a026-4491-b499-a656711f4c52</entry>
Aug 01 17:02:49 user nova-compute[72184]:       <entry name="uuid">e319b28e-a026-4491-b499-a656711f4c52</entry>
Aug 01 17:02:49 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:02:49 user nova-compute[72184]:     </system>
Aug 01 17:02:49 user nova-compute[72184]:   </sysinfo>
Aug 01 17:02:49 user nova-compute[72184]:   <os>
Aug 01 17:02:49 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:02:49 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:02:49 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:02:49 user nova-compute[72184]:   </os>
Aug 01 17:02:49 user nova-compute[72184]:   <features>
Aug 01 17:02:49 user nova-compute[72184]:     <acpi/>
Aug 01 17:02:49 user nova-compute[72184]:     <apic/>
Aug 01 17:02:49 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:02:49 user nova-compute[72184]:   </features>
Aug 01 17:02:49 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:02:49 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:02:49 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:02:49 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:02:49 user nova-compute[72184]:   </clock>
Aug 01 17:02:49 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:02:49 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:02:49 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:02:49 user nova-compute[72184]:   </cpu>
Aug 01 17:02:49 user nova-compute[72184]:   <devices>
Aug 01 17:02:49 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:02:49 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:02:49 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk"/>
Aug 01 17:02:49 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:02:49 user nova-compute[72184]:     </disk>
Aug 01 17:02:49 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:02:49 user nova-compute[72184]:       <mac address="fa:16:3e:2a:b8:aa"/>
Aug 01 17:02:49 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:02:49 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:02:49 user nova-compute[72184]:       <target dev="tapb15c3c84-1c"/>
Aug 01 17:02:49 user nova-compute[72184]:     </interface>
Aug 01 17:02:49 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:02:49 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/console.log" append="off"/>
Aug 01 17:02:49 user nova-compute[72184]:     </serial>
Aug 01 17:02:49 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:02:49 user nova-compute[72184]:     <video>
Aug 01 17:02:49 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:02:49 user nova-compute[72184]:     </video>
Aug 01 17:02:49 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:02:49 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:02:49 user nova-compute[72184]:     </rng>
Aug 01 17:02:49 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:02:49 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:02:49 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:02:49 user nova-compute[72184]:     </memballoon>
Aug 01 17:02:49 user nova-compute[72184]:   </devices>
Aug 01 17:02:49 user nova-compute[72184]: </domain>
Aug 01 17:02:49 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-380742335',display_name='tempest-AttachVolumeNegativeTest-server-380742335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-380742335',id=28,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU6ecdTmg1BGTpYLeejXYLZ6riHTbK9JkE3ZnchwVn8WkWWAXfHnn5vJJdXgU6MSAHCYn63KfMUJAbrg2gItIGUt/D3qH6Qel4BR1DUO+ldC3owMp0Isbfkg2EkuhAs0w==',key_name='tempest-keypair-2125851177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-88w6cic4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=e319b28e-a026-4491-b499-a656711f4c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG os_vif [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb15c3c84-1c, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb15c3c84-1c, col_values=(('external_ids', {'iface-id': 'b15c3c84-1c87-4a8b-a3c5-57b349e24d79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:b8:aa', 'vm-uuid': 'e319b28e-a026-4491-b499-a656711f4c52'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: INFO os_vif [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c')
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:2a:b8:aa, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Creating tmpfile /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/tmpnu8yht83 to verify with other compute node that the instance is on the same shared storage. {{(pid=72184) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-916ef938-62c6-4812-87f8-61772686d937 req-cccf449c-d9de-4171-bd41-28280228d9f7 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-916ef938-62c6-4812-87f8-61772686d937 req-cccf449c-d9de-4171-bd41-28280228d9f7 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-916ef938-62c6-4812-87f8-61772686d937 req-cccf449c-d9de-4171-bd41-28280228d9f7 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-916ef938-62c6-4812-87f8-61772686d937 req-cccf449c-d9de-4171-bd41-28280228d9f7 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-916ef938-62c6-4812-87f8-61772686d937 req-cccf449c-d9de-4171-bd41-28280228d9f7 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:50 user nova-compute[72184]: WARNING nova.compute.manager [req-916ef938-62c6-4812-87f8-61772686d937 req-cccf449c-d9de-4171-bd41-28280228d9f7 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state resized and task_state resize_reverting.
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-changed-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Refreshing instance network info cache due to event network-changed-b15c3c84-1c87-4a8b-a3c5-57b349e24d79. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] Acquiring lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] Acquired lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Refreshing network info cache for port b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:02:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance destroyed successfully.
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.objects.instance [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'resources' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG os_vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc02a82f-c6, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: INFO os_vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6')
Aug 01 17:02:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731460d-64e6-428c-bd70-f69a9bc7cfbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updated VIF entry in instance network info cache for port b15c3c84-1c87-4a8b-a3c5-57b349e24d79. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updating instance_info_cache with network_info: [{"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b7be71b6-f402-4495-ac73-64a704c921a5 req-9e05e08a-89e2-4a11-9b2f-0536020817e5 service nova] Releasing lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5658380-d9da-48f1-8912-5fbd9375ad17]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef (non-flash)
Aug 01 17:02:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6cea8a0-0ce6-4f57-8267-d885792d8bda (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:51 user nova-compute[72184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef (non-flash)
Aug 01 17:02:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff85e30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f288503-e081-4843-ba47-f9d1988d759d]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f24651-1ffe-481a-9d9d-783f385fac0d]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e87a1-255c-4ff3-9023-5d24eb205721]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ae852-43a5-45a3-bafd-3a84c694678b]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a25cd1-17fb-4aac-896b-cc2d873d2344]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd71ebb-e9c8-42cf-8375-bb5efccb05ca]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]
Aug 01 17:02:51 user nova-compute[72184]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.
Aug 01 17:02:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.070s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c01c6-8186-4b17-9324-bf4e4eb9faf0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== disconnect_volume: return (435ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:51 user nova-compute[72184]: INFO nova.compute.manager [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Terminating instance
Aug 01 17:02:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:52 user nova-compute[72184]: WARNING nova.compute.manager [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state resized and task_state resize_reverting.
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] No waiting events found dispatching network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:52 user nova-compute[72184]: WARNING nova.compute.manager [req-64ba7ed8-67ab-41d9-813e-b2c45d865a5b req-b5b4b437-c582-4825-8760-4086fc3d97fc service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received unexpected event network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 for instance with vm_state building and task_state spawning.
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-b441dad3-993d-43be-a15d-5a4190d843e4 req-24c408f3-7e89-4012-a923-109be6f4788b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b441dad3-993d-43be-a15d-5a4190d843e4 req-24c408f3-7e89-4012-a923-109be6f4788b service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b441dad3-993d-43be-a15d-5a4190d843e4 req-24c408f3-7e89-4012-a923-109be6f4788b service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b441dad3-993d-43be-a15d-5a4190d843e4 req-24c408f3-7e89-4012-a923-109be6f4788b service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-b441dad3-993d-43be-a15d-5a4190d843e4 req-24c408f3-7e89-4012-a923-109be6f4788b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-b441dad3-993d-43be-a15d-5a4190d843e4 req-24c408f3-7e89-4012-a923-109be6f4788b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Instance destroyed successfully.
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lazy-loading 'resources' on Instance uuid 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cacaa56-cc, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:64:47,bridge_name='br-int',has_traffic_filtering=True,id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd,network=Network(197273c4-a1c1-4494-9472-2807fdf8e407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cacaa56-cc')
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6a399c0-19, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:da:30,bridge_name='br-int',has_traffic_filtering=True,id=e6a399c0-19c9-40e7-9f15-74b473b7d919,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6a399c0-19')
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a5be4ec-cc, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:53 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=9a5be4ec-cc9b-4990-8ef8-d57b8257f37e,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a5be4ec-cc')
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d982e7a-5d, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=9d982e7a-5dfc-4584-86db-84b3b5fffd98,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d982e7a-5d')
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46f9d91d-ca, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=46f9d91d-ca2a-476b-9fcc-26982244efd3,network=Network(130da389-28f6-41eb-970a-adebb8eb6490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f9d91d-ca')
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6495593b-11, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:54 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=6495593b-1156-493f-bde6-f65ce8176df7,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6495593b-11')
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T17:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1870136684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1870136684',id=26,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPove1Z/UPKId0A/XnqLJPKB6js+p4cxyjbWFa7M8Vni2Ljm55nWrZDW3JtJcDUNqkNwl/y/pjrmQ4TmvxlO5U8mM3IJS0NI7h+Z9QLNnjstvm+6ezyDxJFx6M6KLPymQ==',key_name='tempest-keypair-1337918894',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c8ff26374244a14b18b90ec6cc64470',ramdisk_id='',reservation_id='r-hg5xu1mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-625177496',owner_user_name='tempest-TaggedBootDevicesTest-625177496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dfe9f262c0e43f4a8fe5ffaf61b11de',uuid=6b34f6e1-e9cb-4420-917f-2078cdd8e0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converting VIF {"id": "db5f10fc-224d-49f8-bac6-5a342740fe64", "address": "fa:16:3e:fc:37:2b", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f10fc-22", "ovs_interfaceid": "db5f10fc-224d-49f8-bac6-5a342740fe64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb5f10fc-22, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:54 user nova-compute[72184]: INFO os_vif [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:37:2b,bridge_name='br-int',has_traffic_filtering=True,id=db5f10fc-224d-49f8-bac6-5a342740fe64,network=Network(fd7942cf-2222-406c-adf2-b24c2cc442d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5f10fc-22')
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcurhzvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68739e9-0e46-475d-8311-330c2c2ad4c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909374.2773292, e319b28e-a026-4491-b499-a656711f4c52 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] VM Resumed (Lifecycle Event)
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[80475115-659f-4f79-afd8-0b4f5fdbecac]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef (non-flash)
Aug 01 17:02:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd26e51d-cf15-44b5-8a55-3d40daa9e5ef (non-flash)
Aug 01 17:02:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301846eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] No waiting events found dispatching network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received unexpected event network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 for instance with vm_state building and task_state spawning.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd for instance with vm_state active and task_state deleting.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING nova.compute.manager [req-2ad88b8e-5d98-4bc6-913a-7f977fd3d97b req-e05efbe4-2d6c-418a-a8e0-708e123fddba service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-9a5be4ec-cc9b-4990-8ef8-d57b8257f37e for instance with vm_state active and task_state deleting.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77628f37-3b80-4db8-b44a-cdc6bbfbb214]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] Instance spawned successfully.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72df606-3970-4344-b0cc-98032bae3c17]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c6a42-c9a8-4ceb-9b7d-110d1cb5cd10]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909374.2800012, e319b28e-a026-4491-b499-a656711f4c52 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] VM Started (Lifecycle Event)
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7dab1d-ba75-47f6-90ef-83895f8708b6]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-e6a399c0-19c9-40e7-9f15-74b473b7d919 for instance with vm_state active and task_state deleting.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-46f9d91d-ca2a-476b-9fcc-26982244efd3 for instance with vm_state active and task_state deleting.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-db5f10fc-224d-49f8-bac6-5a342740fe64 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING nova.compute.manager [req-eaeb65d6-4d79-4e26-881d-0fa139d00948 req-6028bda8-63d1-4ed5-bb4c-33f0f5ad9077 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-db5f10fc-224d-49f8-bac6-5a342740fe64 for instance with vm_state active and task_state deleting.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe6d3b-c97a-4dcd-8a0f-5ee959095c76]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9a49f-9f65-4aec-ac63-0e9853d733c0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260]
Aug 01 17:02:54 user nova-compute[72184]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8, portal: 172.16.0.220,3260] successful.
Aug 01 17:02:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Took 10.87 seconds to spawn the instance on the hypervisor.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a1c925-6b43-4dc8-b091-bb3942763cf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8cbbd-dbf0-43bd-9d92-f7750247cec4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.541s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== disconnect_volume: return (544ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpoMObgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:54 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf35187-03a6-425b-9a4f-845267ae630f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'migration_context' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e10aff-4e37-4f08-80ea-1d60cc4248c3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff85e04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243'): ({'sdf'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Removing single pathed devices sdf {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: INFO nova.compute.manager [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Took 12.22 seconds to build instance.
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9e539f-889a-400a-97e8-70c6c3618cca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.020s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c273086b-bead-4d64-82db-5cef868517f5 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.435s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: INFO nova.compute.manager [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Terminating instance
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[230aa8c9-aeef-4e8c-bf97-1377cb3a2eb6]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Flushing IO for device /dev/sdf {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2ce403-a31e-4027-aff5-ae5b5fda0938]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1bd12-23e3-448b-90fa-1d8f6ce97dc0]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] SCSI volumes sdf have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760e871-6689-4823-94ea-375749f6fc81]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f0edd5-5d1d-4c5e-a36b-b1d49d5797d6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260]
Aug 01 17:02:55 user nova-compute[72184]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243, portal: 172.16.0.220,3260] successful.
Aug 01 17:02:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c9e834-6335-4be3-94ef-e67ebfe98243 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74e5d6-a55c-4e27-91ba-1867b5c34635]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.605s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== disconnect_volume: return (607ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiPzMpmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:55 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7762a942-01f4-404a-8e30-96d442506dab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de61d0-065f-4608-83dd-a80853223aab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:55 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:55 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:55 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:02:55 user nova-compute[72184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 (non-flash)
Aug 01 17:02:55 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:02:55 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:02:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff865c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348'): ({'sde'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Removing single pathed devices sde {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e98ab-ebb3-402d-ba02-dcc90a6e5ce2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fc76e6-8045-4a89-8a13-83595c312999]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Flushing IO for device /dev/sde {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9118a737-5bc0-4d1a-a2c7-b9781f3385bc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbf084-6405-4a7c-ac69-1351a1feeb77]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086c231-579e-4420-9a05-8662406095e3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Instance destroyed successfully.
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.objects.instance [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'resources' on Instance uuid 64db4084-3f8d-4f1a-87f7-99a86671fdd1 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45523fdc-41be-400d-840b-0c48fa27d529]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260]
Aug 01 17:02:55 user nova-compute[72184]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348, portal: 172.16.0.220,3260] successful.
Aug 01 17:02:55 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5d9e2-084a-487f-acde-0579a0265348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7354d6f0-77f2-42e0-987c-0892d65d7464]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612266205',display_name='tempest-TestMinimumBasicScenario-server-612266205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612266205',id=21,image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5nPvYMhC5rR/sBonwGmp5lxGTG4O5MHsd6ezhFpv87E9ob3ikbZTyQpqjLXBG5Zs3u83C8VYktVbBI/H7Or9/KMDAmOrEZfqKTo2rhRSesYE8upRrvHg05hc/XfhVgWA==',key_name='tempest-TestMinimumBasicScenario-1780885707',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-6179r134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e826beb3-bd81-44a6-91a5-d7ecf5c60160',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:00:11Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=64db4084-3f8d-4f1a-87f7-99a86671fdd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "address": "fa:16:3e:6e:9c:91", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9c3dfc-14", "ovs_interfaceid": "3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_vif [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.570s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] <== disconnect_volume: return (572ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:02:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Deleting instance files /opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7_del
Aug 01 17:02:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Deletion of /opt/stack/data/nova/instances/6b34f6e1-e9cb-4420-917f-2078cdd8e0e7_del complete
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d9c3dfc-14, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:02:55 user nova-compute[72184]: INFO os_vif [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9c3dfc-14')
Aug 01 17:02:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Deleting instance files /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1_del
Aug 01 17:02:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Deletion of /opt/stack/data/nova/instances/64db4084-3f8d-4f1a-87f7-99a86671fdd1_del complete
Aug 01 17:02:56 user nova-compute[72184]: INFO nova.compute.manager [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Took 4.54 seconds to destroy the instance on the hypervisor.
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:56 user nova-compute[72184]: INFO nova.compute.manager [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.544s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:56 user nova-compute[72184]: WARNING nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-9d982e7a-5dfc-4584-86db-84b3b5fffd98 for instance with vm_state active and task_state deleting.
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-unplugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-unplugged-6495593b-1156-493f-bde6-f65ce8176df7 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Acquiring lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] No waiting events found dispatching network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:56 user nova-compute[72184]: WARNING nova.compute.manager [req-247dec6c-2798-4c0a-a265-aca4a9aef10e req-50a56dee-105b-40fe-9e9f-d6b534052559 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received unexpected event network-vif-plugged-6495593b-1156-493f-bde6-f65ce8176df7 for instance with vm_state active and task_state deleting.
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:56 user nova-compute[72184]: INFO nova.compute.manager [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Swapping old allocation on dict_keys(['5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1']) held by migration 1849ac1c-0c55-4d44-8f95-28e2654e4530 for instance
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-unplugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-unplugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-unplugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] Acquiring lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] No waiting events found dispatching network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:02:56 user nova-compute[72184]: WARNING nova.compute.manager [req-afe6c29e-6b91-408e-9c85-73cf797b75ef req-3529dea0-e1ce-459b-a2a5-c0bdf213de0b service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received unexpected event network-vif-plugged-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 for instance with vm_state active and task_state deleting.
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Overwriting current allocation {'allocations': {'5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '955f909d63034bc8ace106364f8d9b96', 'user_id': '8cb37dea792d4fc98ac32d9c282020d6', 'consumer_generation': 1} on consumer 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:56 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '64db4084-3f8d-4f1a-87f7-99a86671fdd1' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '64db4084-3f8d-4f1a-87f7-99a86671fdd1' (instance-00000015)
Aug 01 17:02:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c99d7d2-08fa-4646-b914-0d3217fa6ddd req-6c1231e2-426b-48a0-84e9-4de743211ed6 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Received event network-vif-deleted-3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:57 user nova-compute[72184]: INFO nova.compute.manager [req-9c99d7d2-08fa-4646-b914-0d3217fa6ddd req-6c1231e2-426b-48a0-84e9-4de743211ed6 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Neutron deleted interface 3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8; detaching it from the instance and deleting it from the info cache
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-9c99d7d2-08fa-4646-b914-0d3217fa6ddd req-6c1231e2-426b-48a0-84e9-4de743211ed6 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:02:57 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Took 0.88 seconds to deallocate network for instance.
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c99d7d2-08fa-4646-b914-0d3217fa6ddd req-6c1231e2-426b-48a0-84e9-4de743211ed6 service nova] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Detach interface failed, port_id=3d9c3dfc-14e3-464e-87e3-7aaa0f1f53b8, reason: Instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:02:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=25.13355255126953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-bf2ae3e7-6432-4c86-b7a5-2ab353e8e736 req-28f69153-d55f-4709-8628-5c61561ba9a1 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-deleted-db5f10fc-224d-49f8-bac6-5a342740fe64 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:02:58 user nova-compute[72184]: INFO nova.compute.manager [req-bf2ae3e7-6432-4c86-b7a5-2ab353e8e736 req-28f69153-d55f-4709-8628-5c61561ba9a1 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Neutron deleted interface db5f10fc-224d-49f8-bac6-5a342740fe64; detaching it from the instance and deleting it from the info cache
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-bf2ae3e7-6432-4c86-b7a5-2ab353e8e736 req-28f69153-d55f-4709-8628-5c61561ba9a1 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "address": "fa:16:3e:f8:64:47", "network": {"id": "197273c4-a1c1-4494-9472-2807fdf8e407", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-846956550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cacaa56-cc", "ovs_interfaceid": "5cacaa56-cc77-4ea8-943d-17ca5e93a7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG os_brick.utils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.569s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.545s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f863d515-a901-4f56-9a2e-2c0651c5d8ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-bf2ae3e7-6432-4c86-b7a5-2ab353e8e736 req-28f69153-d55f-4709-8628-5c61561ba9a1 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Detach interface failed, port_id=db5f10fc-224d-49f8-bac6-5a342740fe64, reason: Instance 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a6b4c5-cdb5-4b14-9aa4-ea302e95cd02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:58 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Deleted allocations for instance 64db4084-3f8d-4f1a-87f7-99a86671fdd1
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3820b074-5e96-42e2-b1b8-7b74150d6df7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a6e8f-631e-4229-a9df-e3418b0b9b55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:02:58 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e17791-81bd-49e3-ae75-5c7e21335a03]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG os_brick.utils [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-668733f0-c297-4d40-ac2a-970b74d447d2 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "64db4084-3f8d-4f1a-87f7-99a86671fdd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.981s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e9785915-eb53-4bc0-ab2f-b0fbe9633015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e319b28e-a026-4491-b499-a656711f4c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:02:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-55aa847a-8501-445e-8ba8-3d2cb954a238 req-31eae4e0-919c-4060-bc34-0da70857a50b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-deleted-5cacaa56-cc77-4ea8-943d-17ca5e93a7dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:00 user nova-compute[72184]: INFO nova.compute.manager [req-55aa847a-8501-445e-8ba8-3d2cb954a238 req-31eae4e0-919c-4060-bc34-0da70857a50b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Neutron deleted interface 5cacaa56-cc77-4ea8-943d-17ca5e93a7dd; detaching it from the instance and deleting it from the info cache
Aug 01 17:03:00 user nova-compute[72184]: DEBUG nova.network.neutron [req-55aa847a-8501-445e-8ba8-3d2cb954a238 req-31eae4e0-919c-4060-bc34-0da70857a50b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [{"id": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "address": "fa:16:3e:56:da:30", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a399c0-19", "ovs_interfaceid": "e6a399c0-19c9-40e7-9f15-74b473b7d919", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "address": "fa:16:3e:9c:b3:98", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5be4ec-cc", "ovs_interfaceid": "9a5be4ec-cc9b-4990-8ef8-d57b8257f37e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "address": "fa:16:3e:08:57:6e", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d982e7a-5d", "ovs_interfaceid": "9d982e7a-5dfc-4584-86db-84b3b5fffd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "address": "fa:16:3e:94:fb:c8", "network": {"id": "130da389-28f6-41eb-970a-adebb8eb6490", "bridge": "br-int", "label": "tempest-device-tagging-net1-1315013377", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f9d91d-ca", "ovs_interfaceid": "46f9d91d-ca2a-476b-9fcc-26982244efd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6495593b-1156-493f-bde6-f65ce8176df7", "address": "fa:16:3e:74:ce:50", "network": {"id": "fd7942cf-2222-406c-adf2-b24c2cc442d4", "bridge": "br-int", "label": "tempest-device-tagging-net2-308351912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1c8ff26374244a14b18b90ec6cc64470", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6495593b-11", "ovs_interfaceid": "6495593b-1156-493f-bde6-f65ce8176df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-55aa847a-8501-445e-8ba8-3d2cb954a238 req-31eae4e0-919c-4060-bc34-0da70857a50b service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Detach interface failed, port_id=5cacaa56-cc77-4ea8-943d-17ca5e93a7dd, reason: Instance 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:03:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:01 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:03:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:01 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:02 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Took 6.56 seconds to deallocate network for instance.
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-1adcbcef-4ced-467e-9d76-0e0a9af20b76 req-7fe267b3-8731-4d1d-91c4-7214bc3fb969 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-deleted-46f9d91d-ca2a-476b-9fcc-26982244efd3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-1adcbcef-4ced-467e-9d76-0e0a9af20b76 req-7fe267b3-8731-4d1d-91c4-7214bc3fb969 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-deleted-6495593b-1156-493f-bde6-f65ce8176df7 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-1adcbcef-4ced-467e-9d76-0e0a9af20b76 req-7fe267b3-8731-4d1d-91c4-7214bc3fb969 service nova] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Received event network-vif-deleted-9d982e7a-5dfc-4584-86db-84b3b5fffd98 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:05 user nova-compute[72184]: INFO nova.compute.manager [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Took 2.55 seconds to detach 3 volumes for instance.
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.259s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:03:05 user nova-compute[72184]: INFO nova.compute.claims [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Claim successful on node user
Aug 01 17:03:05 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Deleted allocations for instance 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7
Aug 01 17:03:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-872db276-0f68-4f3a-a45f-505f1a357e10 tempest-TaggedBootDevicesTest-625177496 tempest-TaggedBootDevicesTest-625177496-project-member] Lock "6b34f6e1-e9cb-4420-917f-2078cdd8e0e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.447s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909370.9429057, 1ba84814-1a19-453e-9482-3fae91ae857d => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:05 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Stopped (Lifecycle Event)
Aug 01 17:03:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6fcbf60d-b2d7-4ad6-a05c-5a45aa330a97 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:03:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.policy [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0c8a60b3824038802bc7bb2298988f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb72853e93848b6995582327cd53b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:03:06 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Creating image(s)
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "/opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "/opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.179s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk 1073741824" returned: 0 in 0.069s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG nova.network.neutron [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Successfully created port: 0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Cannot resize image /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG nova.objects.instance [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'migration_context' on Instance uuid 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Ensure instance console log exists: /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Starting finish_revert_migration {{(pid=72184) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start _get_guest_xml network_info=[{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e790061e-df03-4226-8869-a933938ff5e4', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1ba84814-1a19-453e-9482-3fae91ae857d', 'attached_at': '2023-08-01T17:03:08.000000', 'detached_at': '', 'volume_id': '0fe74796-b077-4ffd-ad2f-275538862cf5', 'serial': '0fe74796-b077-4ffd-ad2f-275538862cf5'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:03:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.objects.instance [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:03:08 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:03:08 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:03:08 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8197da8-f815-492b-9974-6ae76f4a58be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:03:08 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e83feea-7ba4-40ef-8010-953d8c6cdf7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5] added
Aug 01 17:03:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[545d0cf4-f9f4-4e68-b109-9900ce1e5b99]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[695484e2-7c5e-48bc-bd02-9a01d30e8222]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgJFEoNV {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Successfully updated port: 0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgJFEoNV" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[902644ad-0bdb-451a-9644-6e98ce3418e3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgJFEoNV'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquired lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982e212-6a02-4ccb-af05-84e13de43bdb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-changed-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Refreshing instance network info cache due to event network-changed-0d80e567-4050-47d5-b182-dcee05862e6e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] Acquiring lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f8302a-8451-46f9-9ef5-3b698e3f3a9f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0176a6bf-c00c-4ec0-adf5-2353213cbf11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]
Aug 01 17:03:08 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.
Aug 01 17:03:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc11742d-e248-4225-87cd-db41007a1bb0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc9ac3-a444-4acb-a141-283a61724959]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:03:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909373.5651815, 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:08 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] VM Stopped (Lifecycle Event)
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d39ead8f-a32c-4be9-8ff4-ef35a04aaa63 None None] [instance: 6b34f6e1-e9cb-4420-917f-2078cdd8e0e7] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48700950-3391-49c9-a025-5fac5004b7e8]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updating instance_info_cache with network_info: [{"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Releasing lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Instance network_info: |[{"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] Acquired lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Refreshing network info cache for port 0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Start _get_guest_xml network_info=[{"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:03:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1484862329',display_name='tempest-VolumesSnapshotTestJSON-instance-1484862329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1484862329',id=29,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhdVDlwCW92Zom7Jl8YzO6S8jOZh5dU7DBSOfWCFTBuDVZWKA050AsNMUPcSdKoGXvbW6v5qfTbtQY/8VEiDFwKcScXV4GgQZ5OAmu0uclp6uIJhxGM9YMHLIuaN8jHpQ==',key_name='tempest-keypair-1684229642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb72853e93848b6995582327cd53b9a',ramdisk_id='',reservation_id='r-idvtryjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-785628539',owner_user_name='tempest-VolumesSnapshotTestJSON-785628539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0c8a60b3824038802bc7bb2298988f',uuid=2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converting VIF {"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.objects.instance [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:03:08 user nova-compute[72184]:   <uuid>2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8</uuid>
Aug 01 17:03:08 user nova-compute[72184]:   <name>instance-0000001d</name>
Aug 01 17:03:08 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:03:08 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:03:08 user nova-compute[72184]:   <metadata>
Aug 01 17:03:08 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:03:08 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:03:08 user nova-compute[72184]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1484862329</nova:name>
Aug 01 17:03:08 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:03:08</nova:creationTime>
Aug 01 17:03:08 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:03:08 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:03:08 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:03:08 user nova-compute[72184]:       <nova:owner>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:user uuid="8f0c8a60b3824038802bc7bb2298988f">tempest-VolumesSnapshotTestJSON-785628539-project-member</nova:user>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:project uuid="0bb72853e93848b6995582327cd53b9a">tempest-VolumesSnapshotTestJSON-785628539</nova:project>
Aug 01 17:03:08 user nova-compute[72184]:       </nova:owner>
Aug 01 17:03:08 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:03:08 user nova-compute[72184]:       <nova:ports>
Aug 01 17:03:08 user nova-compute[72184]:         <nova:port uuid="0d80e567-4050-47d5-b182-dcee05862e6e">
Aug 01 17:03:08 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 17:03:08 user nova-compute[72184]:         </nova:port>
Aug 01 17:03:08 user nova-compute[72184]:       </nova:ports>
Aug 01 17:03:08 user nova-compute[72184]:     </nova:instance>
Aug 01 17:03:08 user nova-compute[72184]:   </metadata>
Aug 01 17:03:08 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:03:08 user nova-compute[72184]:     <system>
Aug 01 17:03:08 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:03:08 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:03:08 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:03:08 user nova-compute[72184]:       <entry name="serial">2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8</entry>
Aug 01 17:03:08 user nova-compute[72184]:       <entry name="uuid">2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8</entry>
Aug 01 17:03:08 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:03:08 user nova-compute[72184]:     </system>
Aug 01 17:03:08 user nova-compute[72184]:   </sysinfo>
Aug 01 17:03:08 user nova-compute[72184]:   <os>
Aug 01 17:03:08 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:03:08 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:03:08 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:03:08 user nova-compute[72184]:   </os>
Aug 01 17:03:08 user nova-compute[72184]:   <features>
Aug 01 17:03:08 user nova-compute[72184]:     <acpi/>
Aug 01 17:03:08 user nova-compute[72184]:     <apic/>
Aug 01 17:03:08 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:03:08 user nova-compute[72184]:   </features>
Aug 01 17:03:08 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:03:08 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:03:08 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:03:08 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:03:08 user nova-compute[72184]:   </clock>
Aug 01 17:03:08 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:03:08 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:03:08 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:03:08 user nova-compute[72184]:   </cpu>
Aug 01 17:03:08 user nova-compute[72184]:   <devices>
Aug 01 17:03:08 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:03:08 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:03:08 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk"/>
Aug 01 17:03:08 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:03:08 user nova-compute[72184]:     </disk>
Aug 01 17:03:08 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:03:08 user nova-compute[72184]:       <mac address="fa:16:3e:6c:b4:f3"/>
Aug 01 17:03:08 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:08 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:03:08 user nova-compute[72184]:       <target dev="tap0d80e567-40"/>
Aug 01 17:03:08 user nova-compute[72184]:     </interface>
Aug 01 17:03:08 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:03:08 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/console.log" append="off"/>
Aug 01 17:03:08 user nova-compute[72184]:     </serial>
Aug 01 17:03:08 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:03:08 user nova-compute[72184]:     <video>
Aug 01 17:03:08 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:08 user nova-compute[72184]:     </video>
Aug 01 17:03:08 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:03:08 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:03:08 user nova-compute[72184]:     </rng>
Aug 01 17:03:08 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:03:08 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:03:08 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:03:08 user nova-compute[72184]:     </memballoon>
Aug 01 17:03:08 user nova-compute[72184]:   </devices>
Aug 01 17:03:08 user nova-compute[72184]: </domain>
Aug 01 17:03:08 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1484862329',display_name='tempest-VolumesSnapshotTestJSON-instance-1484862329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1484862329',id=29,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhdVDlwCW92Zom7Jl8YzO6S8jOZh5dU7DBSOfWCFTBuDVZWKA050AsNMUPcSdKoGXvbW6v5qfTbtQY/8VEiDFwKcScXV4GgQZ5OAmu0uclp6uIJhxGM9YMHLIuaN8jHpQ==',key_name='tempest-keypair-1684229642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb72853e93848b6995582327cd53b9a',ramdisk_id='',reservation_id='r-idvtryjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-785628539',owner_user_name='tempest-VolumesSnapshotTestJSON-785628539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0c8a60b3824038802bc7bb2298988f',uuid=2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converting VIF {"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG os_vif [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d80e567-40, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d80e567-40, col_values=(('external_ids', {'iface-id': '0d80e567-4050-47d5-b182-dcee05862e6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:b4:f3', 'vm-uuid': '2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:08 user nova-compute[72184]: INFO os_vif [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40')
Aug 01 17:03:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:03:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No VIF found with MAC fa:16:3e:6c:b4:f3, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updated VIF entry in instance network info cache for port 0d80e567-4050-47d5-b182-dcee05862e6e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.network.neutron [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updating instance_info_cache with network_info: [{"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7446c5c5-90b7-403c-942a-585896cc0cb9 req-5afb76d5-460a-4cff-9c68-12fe2ad65a63 service nova] Releasing lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23134366164333434', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134366164333434', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:03:09 user nova-compute[72184]:   <uuid>1ba84814-1a19-453e-9482-3fae91ae857d</uuid>
Aug 01 17:03:09 user nova-compute[72184]:   <name>instance-00000013</name>
Aug 01 17:03:09 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:03:09 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:03:09 user nova-compute[72184]:   <metadata>
Aug 01 17:03:09 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:03:09 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:03:09 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherB-server-1980360680</nova:name>
Aug 01 17:03:09 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:03:08</nova:creationTime>
Aug 01 17:03:09 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:03:09 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:03:09 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:03:09 user nova-compute[72184]:       <nova:owner>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:user uuid="8cb37dea792d4fc98ac32d9c282020d6">tempest-ServerActionsTestOtherB-1303337288-project-member</nova:user>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:project uuid="955f909d63034bc8ace106364f8d9b96">tempest-ServerActionsTestOtherB-1303337288</nova:project>
Aug 01 17:03:09 user nova-compute[72184]:       </nova:owner>
Aug 01 17:03:09 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:03:09 user nova-compute[72184]:       <nova:ports>
Aug 01 17:03:09 user nova-compute[72184]:         <nova:port uuid="fc02a82f-c678-49e6-8196-5213ef90e225">
Aug 01 17:03:09 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 17:03:09 user nova-compute[72184]:         </nova:port>
Aug 01 17:03:09 user nova-compute[72184]:       </nova:ports>
Aug 01 17:03:09 user nova-compute[72184]:     </nova:instance>
Aug 01 17:03:09 user nova-compute[72184]:   </metadata>
Aug 01 17:03:09 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:03:09 user nova-compute[72184]:     <system>
Aug 01 17:03:09 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:03:09 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:03:09 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:03:09 user nova-compute[72184]:       <entry name="serial">1ba84814-1a19-453e-9482-3fae91ae857d</entry>
Aug 01 17:03:09 user nova-compute[72184]:       <entry name="uuid">1ba84814-1a19-453e-9482-3fae91ae857d</entry>
Aug 01 17:03:09 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:03:09 user nova-compute[72184]:     </system>
Aug 01 17:03:09 user nova-compute[72184]:   </sysinfo>
Aug 01 17:03:09 user nova-compute[72184]:   <os>
Aug 01 17:03:09 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:03:09 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:03:09 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:03:09 user nova-compute[72184]:   </os>
Aug 01 17:03:09 user nova-compute[72184]:   <features>
Aug 01 17:03:09 user nova-compute[72184]:     <acpi/>
Aug 01 17:03:09 user nova-compute[72184]:     <apic/>
Aug 01 17:03:09 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:03:09 user nova-compute[72184]:   </features>
Aug 01 17:03:09 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:03:09 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:03:09 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:03:09 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:03:09 user nova-compute[72184]:   </clock>
Aug 01 17:03:09 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:03:09 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:03:09 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:03:09 user nova-compute[72184]:   </cpu>
Aug 01 17:03:09 user nova-compute[72184]:   <devices>
Aug 01 17:03:09 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:03:09 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:03:09 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk"/>
Aug 01 17:03:09 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:03:09 user nova-compute[72184]:     </disk>
Aug 01 17:03:09 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:03:09 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:03:09 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 17:03:09 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:03:09 user nova-compute[72184]:       <serial>0fe74796-b077-4ffd-ad2f-275538862cf5</serial>
Aug 01 17:03:09 user nova-compute[72184]:     </disk>
Aug 01 17:03:09 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:03:09 user nova-compute[72184]:       <mac address="fa:16:3e:0f:89:fd"/>
Aug 01 17:03:09 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:09 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:03:09 user nova-compute[72184]:       <target dev="tapfc02a82f-c6"/>
Aug 01 17:03:09 user nova-compute[72184]:     </interface>
Aug 01 17:03:09 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:03:09 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/console.log" append="off"/>
Aug 01 17:03:09 user nova-compute[72184]:     </serial>
Aug 01 17:03:09 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:03:09 user nova-compute[72184]:     <video>
Aug 01 17:03:09 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:09 user nova-compute[72184]:     </video>
Aug 01 17:03:09 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:03:09 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:03:09 user nova-compute[72184]:     </rng>
Aug 01 17:03:09 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:03:09 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:03:09 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:03:09 user nova-compute[72184]:     </memballoon>
Aug 01 17:03:09 user nova-compute[72184]:   </devices>
Aug 01 17:03:09 user nova-compute[72184]: </domain>
Aug 01 17:03:09 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG os_vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc02a82f-c6, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc02a82f-c6, col_values=(('external_ids', {'iface-id': 'fc02a82f-c678-49e6-8196-5213ef90e225', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:89:fd', 'vm-uuid': '1ba84814-1a19-453e-9482-3fae91ae857d'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:03:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:09 user nova-compute[72184]: INFO os_vif [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6')
Aug 01 17:03:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:10 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909375.8281612, 64db4084-3f8d-4f1a-87f7-99a86671fdd1 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:10 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] VM Stopped (Lifecycle Event)
Aug 01 17:03:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-787c58b2-1f7c-4113-978e-5d344f655552 None None] [instance: 64db4084-3f8d-4f1a-87f7-99a86671fdd1] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-0aa166b8-1b33-49d7-9849-95e897eac2ab req-a0a313bb-6a82-40dd-90ff-4dc4685e3072 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0aa166b8-1b33-49d7-9849-95e897eac2ab req-a0a313bb-6a82-40dd-90ff-4dc4685e3072 service nova] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0aa166b8-1b33-49d7-9849-95e897eac2ab req-a0a313bb-6a82-40dd-90ff-4dc4685e3072 service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0aa166b8-1b33-49d7-9849-95e897eac2ab req-a0a313bb-6a82-40dd-90ff-4dc4685e3072 service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-0aa166b8-1b33-49d7-9849-95e897eac2ab req-a0a313bb-6a82-40dd-90ff-4dc4685e3072 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] No waiting events found dispatching network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:11 user nova-compute[72184]: WARNING nova.compute.manager [req-0aa166b8-1b33-49d7-9849-95e897eac2ab req-a0a313bb-6a82-40dd-90ff-4dc4685e3072 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received unexpected event network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e for instance with vm_state building and task_state spawning.
Aug 01 17:03:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] No waiting events found dispatching network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:13 user nova-compute[72184]: WARNING nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received unexpected event network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e for instance with vm_state building and task_state spawning.
Aug 01 17:03:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:13 user nova-compute[72184]: WARNING nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state resized and task_state resize_reverting.
Aug 01 17:03:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:13 user nova-compute[72184]: WARNING nova.compute.manager [req-e413c942-4014-4749-8cac-bdcd2dabf325 req-229f2d4b-7833-4bd2-ba95-45b0271dd8df service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state resized and task_state resize_reverting.
Aug 01 17:03:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909394.3028097, 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] VM Resumed (Lifecycle Event)
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Instance spawned successfully.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909394.3070686, 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] VM Started (Lifecycle Event)
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Took 7.65 seconds to spawn the instance on the hypervisor.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909394.4455564, 1ba84814-1a19-453e-9482-3fae91ae857d => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Resumed (Lifecycle Event)
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance running successfully.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] finish_revert_migration finished successfully. {{(pid=72184) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909394.447752, 1ba84814-1a19-453e-9482-3fae91ae857d => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Started (Lifecycle Event)
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Took 9.05 seconds to build instance.
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-be98a52d-ba6c-405b-985c-028f5db7a45b tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.172s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 17:03:14 user nova-compute[72184]: INFO nova.compute.manager [None req-42bd234c-8660-4589-ba2d-d7b11ff048b4 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance to original state: 'active'
Aug 01 17:03:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:03:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:30 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:03:30 user nova-compute[72184]: INFO nova.compute.claims [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Claim successful on node user
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:03:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:03:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:03:31 user nova-compute[72184]: INFO nova.virt.block_device [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Booting with volume-backed-image 445427d2-2c17-4b94-ba10-8b1151983d7e at /dev/vda
Aug 01 17:03:31 user nova-compute[72184]: DEBUG nova.policy [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9ae86640754099bb01c48a6807075f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13772bce6fa482189f819cb065170b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:03:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Successfully created port: 732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Successfully updated port: 732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-changed-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Refreshing instance network info cache due to event network-changed-732c42b3-c7fa-46d8-aa0f-fea08031e568. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] Acquiring lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:33 user nova-compute[72184]: DEBUG nova.network.neutron [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG nova.network.neutron [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updating instance_info_cache with network_info: [{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance network_info: |[{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] Acquired lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Refreshing network info cache for port 732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updated VIF entry in instance network info cache for port 732c42b3-c7fa-46d8-aa0f-fea08031e568. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updating instance_info_cache with network_info: [{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9a3ed31d-565a-4f76-9e07-e9d804355531 req-16ca77cc-6cdd-4210-92e3-3932afe98e5e service nova] Releasing lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:41 user nova-compute[72184]: DEBUG os_brick.utils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a8434-a548-4954-9817-4283317339f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25633ef3-3db3-4eed-bba9-6446ad08e741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03317696-e231-49e5-9db4-8d22dbd4a8d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046f9a4-f857-46b0-8afb-fc494904f359]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:03:42 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:03:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8d62d2-1564-4a3b-91fa-b5c5bc47c6d7]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG os_brick.utils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updating existing volume attachment record: 21c38bf8-f160-444b-bc55-fce962e0eb0d {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:03:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:03:49 user nova-compute[72184]: INFO nova.compute.claims [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Claim successful on node user
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:03:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:03:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.policy [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ae2243c375e4f23a9bb9d3abaab63cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793a9d1897f42be86ed38b4dff4f977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:03:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Creating image(s)
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "/opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "/opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "/opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "f10dc4eb4a85e4e2afe07fddc2588714cbee2819" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "f10dc4eb4a85e4e2afe07fddc2588714cbee2819" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json" returned: 0 in 0.578s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Successfully created port: a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.part --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.virt.images [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] 2801757d-6cdd-420e-9f69-7ce7def516c4 was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:03:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.part /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:03:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Creating image(s)
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Ensure instance console log exists: /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Start _get_guest_xml network_info=[{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '21c38bf8-f160-444b-bc55-fce962e0eb0d', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52833ca5-abaa-44e7-90b1-3e18928101c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed70de59-236b-495b-a329-0fcd626c77dd', 'serial': 'ed70de59-236b-495b-a329-0fcd626c77dd'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:03:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:03:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:03:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:03:51 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec807c75-15c7-4a3c-98c1-167e7653545f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:03:51 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb7a12-f514-4306-93a0-752406a08495]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd] added
Aug 01 17:03:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f033d6-5724-4de0-bc22-9608716e59a3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.117s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f6e5c7-1caf-4b99-970b-9bfd7921d571]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpazWRjU {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpazWRjU" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[090138af-31a3-4cb6-9360-c994e1439c3d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpazWRjU'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.074s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01af785-6c00-4a5e-acd4-a6d309d5bf12]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.part /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.converted" returned: 0 in 0.489s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58646ff-5887-48b0-b0f3-ae1ca55e871d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "f10dc4eb4a85e4e2afe07fddc2588714cbee2819" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.297s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb7169-d919-455d-b688-7e94e9af84c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260]
Aug 01 17:03:51 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260] successful.
Aug 01 17:03:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[644a94a6-7ced-4b51-83e0-0cd27c0a34ec]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5122a2-7f70-4d36-b39e-12bc196a3328]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:03:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:03:51 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:03:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.671s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.113s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e4b0c-0858-4ffb-bdf6-8e717259f8a4]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 --force-share --output=json" returned: 0 in 0.359s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "f10dc4eb4a85e4e2afe07fddc2588714cbee2819" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "f10dc4eb4a85e4e2afe07fddc2588714cbee2819" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819,backing_fmt=raw /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819,backing_fmt=raw /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk 1073741824" returned: 0 in 0.053s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "f10dc4eb4a85e4e2afe07fddc2588714cbee2819" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Successfully updated port: a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing instance network info cache due to event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.neutron [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Cannot resize image /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'migration_context' on Instance uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Ensure instance console log exists: /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.neutron [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.neutron [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-30a4a170-02b7-40c8-bdcb-e45f43119e86 req-fff307db-6fa2-4ed0-a262-8ab2e9f724bb service nova] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.812s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== connect_volume: return (1814ms) {'type': 'block', 'scsi_wwn': '23962393665343737', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962393665343737', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1665417027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1665417027',id=30,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-znime3vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:31Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=52833ca5-abaa-44e7-90b1-3e18928101c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'pci_devices' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:03:53 user nova-compute[72184]:   <uuid>52833ca5-abaa-44e7-90b1-3e18928101c2</uuid>
Aug 01 17:03:53 user nova-compute[72184]:   <name>instance-0000001e</name>
Aug 01 17:03:53 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:03:53 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:03:53 user nova-compute[72184]:   <metadata>
Aug 01 17:03:53 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:03:53 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1665417027</nova:name>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:03:51</nova:creationTime>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:03:53 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:03:53 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:owner>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:user uuid="1b9ae86640754099bb01c48a6807075f">tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member</nova:user>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:project uuid="b13772bce6fa482189f819cb065170b3">tempest-ServerBootFromVolumeStableRescueTest-388641611</nova:project>
Aug 01 17:03:53 user nova-compute[72184]:       </nova:owner>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:ports>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:port uuid="732c42b3-c7fa-46d8-aa0f-fea08031e568">
Aug 01 17:03:53 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:03:53 user nova-compute[72184]:         </nova:port>
Aug 01 17:03:53 user nova-compute[72184]:       </nova:ports>
Aug 01 17:03:53 user nova-compute[72184]:     </nova:instance>
Aug 01 17:03:53 user nova-compute[72184]:   </metadata>
Aug 01 17:03:53 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:03:53 user nova-compute[72184]:     <system>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="serial">52833ca5-abaa-44e7-90b1-3e18928101c2</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="uuid">52833ca5-abaa-44e7-90b1-3e18928101c2</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:03:53 user nova-compute[72184]:     </system>
Aug 01 17:03:53 user nova-compute[72184]:   </sysinfo>
Aug 01 17:03:53 user nova-compute[72184]:   <os>
Aug 01 17:03:53 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:03:53 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:03:53 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:03:53 user nova-compute[72184]:   </os>
Aug 01 17:03:53 user nova-compute[72184]:   <features>
Aug 01 17:03:53 user nova-compute[72184]:     <acpi/>
Aug 01 17:03:53 user nova-compute[72184]:     <apic/>
Aug 01 17:03:53 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:03:53 user nova-compute[72184]:   </features>
Aug 01 17:03:53 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:03:53 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:03:53 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:03:53 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:03:53 user nova-compute[72184]:   </clock>
Aug 01 17:03:53 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:03:53 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:03:53 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:03:53 user nova-compute[72184]:   </cpu>
Aug 01 17:03:53 user nova-compute[72184]:   <devices>
Aug 01 17:03:53 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:03:53 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:03:53 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:03:53 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:03:53 user nova-compute[72184]:       <serial>ed70de59-236b-495b-a329-0fcd626c77dd</serial>
Aug 01 17:03:53 user nova-compute[72184]:     </disk>
Aug 01 17:03:53 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:03:53 user nova-compute[72184]:       <mac address="fa:16:3e:fc:5b:a4"/>
Aug 01 17:03:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:53 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:03:53 user nova-compute[72184]:       <target dev="tap732c42b3-c7"/>
Aug 01 17:03:53 user nova-compute[72184]:     </interface>
Aug 01 17:03:53 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:03:53 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/console.log" append="off"/>
Aug 01 17:03:53 user nova-compute[72184]:     </serial>
Aug 01 17:03:53 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:03:53 user nova-compute[72184]:     <video>
Aug 01 17:03:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:53 user nova-compute[72184]:     </video>
Aug 01 17:03:53 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:03:53 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:03:53 user nova-compute[72184]:     </rng>
Aug 01 17:03:53 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:03:53 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:03:53 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:03:53 user nova-compute[72184]:     </memballoon>
Aug 01 17:03:53 user nova-compute[72184]:   </devices>
Aug 01 17:03:53 user nova-compute[72184]: </domain>
Aug 01 17:03:53 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1665417027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1665417027',id=30,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-znime3vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:31Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=52833ca5-abaa-44e7-90b1-3e18928101c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG os_vif [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap732c42b3-c7, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap732c42b3-c7, col_values=(('external_ids', {'iface-id': '732c42b3-c7fa-46d8-aa0f-fea08031e568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:5b:a4', 'vm-uuid': '52833ca5-abaa-44e7-90b1-3e18928101c2'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: INFO os_vif [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7')
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No VIF found with MAC fa:16:3e:fc:5b:a4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance network_info: |[{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Start _get_guest_xml network_info=[{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T17:03:46Z,direct_url=<?>,disk_format='qcow2',id=2801757d-6cdd-420e-9f69-7ce7def516c4,min_disk=0,min_ram=0,name='tempest-scenario-img--226036789',owner='d793a9d1897f42be86ed38b4dff4f977',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T17:03:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '2801757d-6cdd-420e-9f69-7ce7def516c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:03:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T17:03:46Z,direct_url=<?>,disk_format='qcow2',id=2801757d-6cdd-420e-9f69-7ce7def516c4,min_disk=0,min_ram=0,name='tempest-scenario-img--226036789',owner='d793a9d1897f42be86ed38b4dff4f977',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T17:03:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1017071891',display_name='tempest-TestMinimumBasicScenario-server-1017071891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1017071891',id=31,image_ref='2801757d-6cdd-420e-9f69-7ce7def516c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZsCF9VvfIlh/s49Wj40qHeGG3DyV12dg5QiT1liFzyMkukD2Qhqj6OoK1ijQfns4qAhlfkNCOrGzJHH6Locgm8IkHfbz8/ZnIK9rlg9nd0rVlSUNYbSyPo1cyp0G/N0g==',key_name='tempest-TestMinimumBasicScenario-1856804338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-abwkm3p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2801757d-6cdd-420e-9f69-7ce7def516c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:50Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=612209a3-7d0f-44a3-b237-9bdccaab6d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'pci_devices' on Instance uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:03:53 user nova-compute[72184]:   <uuid>612209a3-7d0f-44a3-b237-9bdccaab6d8a</uuid>
Aug 01 17:03:53 user nova-compute[72184]:   <name>instance-0000001f</name>
Aug 01 17:03:53 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:03:53 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:03:53 user nova-compute[72184]:   <metadata>
Aug 01 17:03:53 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:03:53 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:name>tempest-TestMinimumBasicScenario-server-1017071891</nova:name>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:03:53</nova:creationTime>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:03:53 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:03:53 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:owner>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:user uuid="9ae2243c375e4f23a9bb9d3abaab63cc">tempest-TestMinimumBasicScenario-582463682-project-member</nova:user>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:project uuid="d793a9d1897f42be86ed38b4dff4f977">tempest-TestMinimumBasicScenario-582463682</nova:project>
Aug 01 17:03:53 user nova-compute[72184]:       </nova:owner>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:root type="image" uuid="2801757d-6cdd-420e-9f69-7ce7def516c4"/>
Aug 01 17:03:53 user nova-compute[72184]:       <nova:ports>
Aug 01 17:03:53 user nova-compute[72184]:         <nova:port uuid="a5f4f6cf-37a4-43ea-84df-e5461fa98990">
Aug 01 17:03:53 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 17:03:53 user nova-compute[72184]:         </nova:port>
Aug 01 17:03:53 user nova-compute[72184]:       </nova:ports>
Aug 01 17:03:53 user nova-compute[72184]:     </nova:instance>
Aug 01 17:03:53 user nova-compute[72184]:   </metadata>
Aug 01 17:03:53 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:03:53 user nova-compute[72184]:     <system>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="serial">612209a3-7d0f-44a3-b237-9bdccaab6d8a</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="uuid">612209a3-7d0f-44a3-b237-9bdccaab6d8a</entry>
Aug 01 17:03:53 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:03:53 user nova-compute[72184]:     </system>
Aug 01 17:03:53 user nova-compute[72184]:   </sysinfo>
Aug 01 17:03:53 user nova-compute[72184]:   <os>
Aug 01 17:03:53 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:03:53 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:03:53 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:03:53 user nova-compute[72184]:   </os>
Aug 01 17:03:53 user nova-compute[72184]:   <features>
Aug 01 17:03:53 user nova-compute[72184]:     <acpi/>
Aug 01 17:03:53 user nova-compute[72184]:     <apic/>
Aug 01 17:03:53 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:03:53 user nova-compute[72184]:   </features>
Aug 01 17:03:53 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:03:53 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:03:53 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:03:53 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:03:53 user nova-compute[72184]:   </clock>
Aug 01 17:03:53 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:03:53 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:03:53 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:03:53 user nova-compute[72184]:   </cpu>
Aug 01 17:03:53 user nova-compute[72184]:   <devices>
Aug 01 17:03:53 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:03:53 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:03:53 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk"/>
Aug 01 17:03:53 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:03:53 user nova-compute[72184]:     </disk>
Aug 01 17:03:53 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:03:53 user nova-compute[72184]:       <mac address="fa:16:3e:5e:96:39"/>
Aug 01 17:03:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:53 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:03:53 user nova-compute[72184]:       <target dev="tapa5f4f6cf-37"/>
Aug 01 17:03:53 user nova-compute[72184]:     </interface>
Aug 01 17:03:53 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:03:53 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/console.log" append="off"/>
Aug 01 17:03:53 user nova-compute[72184]:     </serial>
Aug 01 17:03:53 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:03:53 user nova-compute[72184]:     <video>
Aug 01 17:03:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:03:53 user nova-compute[72184]:     </video>
Aug 01 17:03:53 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:03:53 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:03:53 user nova-compute[72184]:     </rng>
Aug 01 17:03:53 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:03:53 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:03:53 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:03:53 user nova-compute[72184]:     </memballoon>
Aug 01 17:03:53 user nova-compute[72184]:   </devices>
Aug 01 17:03:53 user nova-compute[72184]: </domain>
Aug 01 17:03:53 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1017071891',display_name='tempest-TestMinimumBasicScenario-server-1017071891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1017071891',id=31,image_ref='2801757d-6cdd-420e-9f69-7ce7def516c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZsCF9VvfIlh/s49Wj40qHeGG3DyV12dg5QiT1liFzyMkukD2Qhqj6OoK1ijQfns4qAhlfkNCOrGzJHH6Locgm8IkHfbz8/ZnIK9rlg9nd0rVlSUNYbSyPo1cyp0G/N0g==',key_name='tempest-TestMinimumBasicScenario-1856804338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-abwkm3p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2801757d-6cdd-420e-9f69-7ce7def516c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:50Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=612209a3-7d0f-44a3-b237-9bdccaab6d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG os_vif [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5f4f6cf-37, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5f4f6cf-37, col_values=(('external_ids', {'iface-id': 'a5f4f6cf-37a4-43ea-84df-e5461fa98990', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:96:39', 'vm-uuid': '612209a3-7d0f-44a3-b237-9bdccaab6d8a'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:53 user nova-compute[72184]: INFO os_vif [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37')
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No VIF found with MAC fa:16:3e:5e:96:39, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:03:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909438.3423567, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Resumed (Lifecycle Event)
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-77d636a9-3845-41d3-9fb6-8ce000d8af76 req-b94f2d99-602a-4da4-8208-86a69176daad service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-77d636a9-3845-41d3-9fb6-8ce000d8af76 req-b94f2d99-602a-4da4-8208-86a69176daad service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-77d636a9-3845-41d3-9fb6-8ce000d8af76 req-b94f2d99-602a-4da4-8208-86a69176daad service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-77d636a9-3845-41d3-9fb6-8ce000d8af76 req-b94f2d99-602a-4da4-8208-86a69176daad service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-77d636a9-3845-41d3-9fb6-8ce000d8af76 req-b94f2d99-602a-4da4-8208-86a69176daad service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:58 user nova-compute[72184]: WARNING nova.compute.manager [req-77d636a9-3845-41d3-9fb6-8ce000d8af76 req-b94f2d99-602a-4da4-8208-86a69176daad service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state building and task_state spawning.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9511d09-b895-41cd-be8f-7afd418f2423 req-86a5fe69-637f-4aa5-93f0-f697ceec6cb4 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9511d09-b895-41cd-be8f-7afd418f2423 req-86a5fe69-637f-4aa5-93f0-f697ceec6cb4 service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9511d09-b895-41cd-be8f-7afd418f2423 req-86a5fe69-637f-4aa5-93f0-f697ceec6cb4 service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9511d09-b895-41cd-be8f-7afd418f2423 req-86a5fe69-637f-4aa5-93f0-f697ceec6cb4 service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9511d09-b895-41cd-be8f-7afd418f2423 req-86a5fe69-637f-4aa5-93f0-f697ceec6cb4 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:58 user nova-compute[72184]: WARNING nova.compute.manager [req-d9511d09-b895-41cd-be8f-7afd418f2423 req-86a5fe69-637f-4aa5-93f0-f697ceec6cb4 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state building and task_state spawning.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-60427b9c-f763-49ed-8423-2ee9d086242d req-b78f5a36-a389-470b-9156-21b5206cc808 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60427b9c-f763-49ed-8423-2ee9d086242d req-b78f5a36-a389-470b-9156-21b5206cc808 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60427b9c-f763-49ed-8423-2ee9d086242d req-b78f5a36-a389-470b-9156-21b5206cc808 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60427b9c-f763-49ed-8423-2ee9d086242d req-b78f5a36-a389-470b-9156-21b5206cc808 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-60427b9c-f763-49ed-8423-2ee9d086242d req-b78f5a36-a389-470b-9156-21b5206cc808 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:58 user nova-compute[72184]: WARNING nova.compute.manager [req-60427b9c-f763-49ed-8423-2ee9d086242d req-b78f5a36-a389-470b-9156-21b5206cc808 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state building and task_state spawning.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-af30c0f4-9b12-4010-9c73-8cea8f78117c req-4f064810-1508-4a72-9d8d-52c47ae52d89 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af30c0f4-9b12-4010-9c73-8cea8f78117c req-4f064810-1508-4a72-9d8d-52c47ae52d89 service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af30c0f4-9b12-4010-9c73-8cea8f78117c req-4f064810-1508-4a72-9d8d-52c47ae52d89 service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af30c0f4-9b12-4010-9c73-8cea8f78117c req-4f064810-1508-4a72-9d8d-52c47ae52d89 service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-af30c0f4-9b12-4010-9c73-8cea8f78117c req-4f064810-1508-4a72-9d8d-52c47ae52d89 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:03:58 user nova-compute[72184]: WARNING nova.compute.manager [req-af30c0f4-9b12-4010-9c73-8cea8f78117c req-4f064810-1508-4a72-9d8d-52c47ae52d89 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state building and task_state spawning.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance spawned successfully.
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance spawned successfully.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:03:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7116MB free_disk=25.13799285888672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909438.344383, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Started (Lifecycle Event)
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Took 7.96 seconds to spawn the instance on the hypervisor.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:58 user nova-compute[72184]: INFO nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Took 8.63 seconds to spawn the instance on the hypervisor.
Aug 01 17:03:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:59 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909438.363762, 612209a3-7d0f-44a3-b237-9bdccaab6d8a => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:59 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] VM Resumed (Lifecycle Event)
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e9785915-eb53-4bc0-ab2f-b0fbe9633015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e319b28e-a026-4491-b499-a656711f4c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 52833ca5-abaa-44e7-90b1-3e18928101c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:59 user nova-compute[72184]: INFO nova.compute.manager [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Took 9.76 seconds to build instance.
Aug 01 17:03:59 user nova-compute[72184]: INFO nova.compute.manager [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Took 28.40 seconds to build instance.
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1be0b7fb-fe8e-47f5-b9d3-e95305d3cd5b tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.908s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909438.367726, 612209a3-7d0f-44a3-b237-9bdccaab6d8a => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:03:59 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] VM Started (Lifecycle Event)
Aug 01 17:03:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-109a71c7-9079-4495-9bea-88b6a42e75ab tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.516s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:03:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:01 user nova-compute[72184]: INFO nova.compute.manager [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Terminating instance
Aug 01 17:04:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-0bd9339b-30c5-46bb-bd0a-4063c990e045 req-797e00fe-f978-49f4-9472-dc996ac8347b service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-vif-unplugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0bd9339b-30c5-46bb-bd0a-4063c990e045 req-797e00fe-f978-49f4-9472-dc996ac8347b service nova] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0bd9339b-30c5-46bb-bd0a-4063c990e045 req-797e00fe-f978-49f4-9472-dc996ac8347b service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0bd9339b-30c5-46bb-bd0a-4063c990e045 req-797e00fe-f978-49f4-9472-dc996ac8347b service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-0bd9339b-30c5-46bb-bd0a-4063c990e045 req-797e00fe-f978-49f4-9472-dc996ac8347b service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] No waiting events found dispatching network-vif-unplugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-0bd9339b-30c5-46bb-bd0a-4063c990e045 req-797e00fe-f978-49f4-9472-dc996ac8347b service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-vif-unplugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:04:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Instance destroyed successfully.
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.objects.instance [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lazy-loading 'resources' on Instance uuid e9785915-eb53-4bc0-ab2f-b0fbe9633015 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-299803923',display_name='tempest-VolumesActionsTest-instance-299803923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-299803923',id=27,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff6a0fda580e4e6a9ea4e26d30df9e67',ramdisk_id='',reservation_id='r-io0dznxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-197584980',owner_user_name='tempest-VolumesActionsTest-197584980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:02:16Z,user_data=None,user_id='8fe75ee370f04c89af06c3eb592c585a',uuid=e9785915-eb53-4bc0-ab2f-b0fbe9633015,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converting VIF {"id": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "address": "fa:16:3e:e4:dd:9a", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc9dd16-ce", "ovs_interfaceid": "dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG os_vif [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbc9dd16-ce, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:04:02 user nova-compute[72184]: INFO os_vif [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dd:9a,bridge_name='br-int',has_traffic_filtering=True,id=dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc9dd16-ce')
Aug 01 17:04:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Deleting instance files /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015_del
Aug 01 17:04:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Deletion of /opt/stack/data/nova/instances/e9785915-eb53-4bc0-ab2f-b0fbe9633015_del complete
Aug 01 17:04:02 user nova-compute[72184]: INFO nova.compute.manager [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 01 17:04:02 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:02 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:03 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Took 0.85 seconds to deallocate network for instance.
Aug 01 17:04:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-6adc09fa-6725-4c35-8719-ca8ee4c42c61 req-a98b4b3a-a2fb-466b-bdef-e780ae1cb38c service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-vif-deleted-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-43879798-b94d-40a0-8603-241ee565a499 req-954906ac-a019-4589-8d09-dc2a96babb9d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received event network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-43879798-b94d-40a0-8603-241ee565a499 req-954906ac-a019-4589-8d09-dc2a96babb9d service nova] Acquiring lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-43879798-b94d-40a0-8603-241ee565a499 req-954906ac-a019-4589-8d09-dc2a96babb9d service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-43879798-b94d-40a0-8603-241ee565a499 req-954906ac-a019-4589-8d09-dc2a96babb9d service nova] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-43879798-b94d-40a0-8603-241ee565a499 req-954906ac-a019-4589-8d09-dc2a96babb9d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] No waiting events found dispatching network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:03 user nova-compute[72184]: WARNING nova.compute.manager [req-43879798-b94d-40a0-8603-241ee565a499 req-954906ac-a019-4589-8d09-dc2a96babb9d service nova] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Received unexpected event network-vif-plugged-dbc9dd16-ce17-4f9a-92e3-2d90c2cfb4d5 for instance with vm_state deleted and task_state None.
Aug 01 17:04:03 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:04:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.641s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:03 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Deleted allocations for instance e9785915-eb53-4bc0-ab2f-b0fbe9633015
Aug 01 17:04:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:04:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-89c5809f-ce42-418e-bc29-f7106a7cd287 tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "e9785915-eb53-4bc0-ab2f-b0fbe9633015" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:17 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909442.0472286, e9785915-eb53-4bc0-ab2f-b0fbe9633015 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:04:17 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] VM Stopped (Lifecycle Event)
Aug 01 17:04:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f505f710-0e69-402c-bbcc-8922472375cf None None] [instance: e9785915-eb53-4bc0-ab2f-b0fbe9633015] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:04:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:26 user nova-compute[72184]: INFO nova.compute.manager [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Unrescuing
Aug 01 17:04:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'flavor' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-dde9e81f-d305-4750-b4fe-8fd0053dce04 req-647156b1-4ea0-41c4-b86e-1dd6b0600323 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dde9e81f-d305-4750-b4fe-8fd0053dce04 req-647156b1-4ea0-41c4-b86e-1dd6b0600323 service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dde9e81f-d305-4750-b4fe-8fd0053dce04 req-647156b1-4ea0-41c4-b86e-1dd6b0600323 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dde9e81f-d305-4750-b4fe-8fd0053dce04 req-647156b1-4ea0-41c4-b86e-1dd6b0600323 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-dde9e81f-d305-4750-b4fe-8fd0053dce04 req-647156b1-4ea0-41c4-b86e-1dd6b0600323 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:27 user nova-compute[72184]: WARNING nova.compute.manager [req-dde9e81f-d305-4750-b4fe-8fd0053dce04 req-647156b1-4ea0-41c4-b86e-1dd6b0600323 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:04:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance destroyed successfully.
Aug 01 17:04:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:28 user nova-compute[72184]: INFO nova.compute.manager [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Detaching volume 702dfe35-44fa-40aa-a730-faaedfa48bd8
Aug 01 17:04:28 user nova-compute[72184]: INFO nova.virt.block_device [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Attempting to driver detach volume 702dfe35-44fa-40aa-a730-faaedfa48bd8 from mountpoint /dev/vdb
Aug 01 17:04:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Attempting to detach device vdb from instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:04:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:04:28 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:04:28 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 17:04:28 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:04:28 user nova-compute[72184]:   <serial>702dfe35-44fa-40aa-a730-faaedfa48bd8</serial>
Aug 01 17:04:28 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:04:28 user nova-compute[72184]: </disk>
Aug 01 17:04:28 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:04:28 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully detached device vdb from instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f from the persistent domain config.
Aug 01 17:04:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:04:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:04:28 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:04:28 user nova-compute[72184]:   <source dev="/dev/sdg"/>
Aug 01 17:04:28 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:04:28 user nova-compute[72184]:   <serial>702dfe35-44fa-40aa-a730-faaedfa48bd8</serial>
Aug 01 17:04:28 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:04:28 user nova-compute[72184]: </disk>
Aug 01 17:04:28 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909469.2351732, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:04:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully detached device vdb from instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f from the live domain config.
Aug 01 17:04:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksADmbOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:04:29 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeff3b5f-8967-45d7-842a-e96bc4933f0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937f285-aa9c-4806-883a-7c796d195262]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:29 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:29 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:29 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30277d1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8'): ({'sdg'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Removing single pathed devices sdg {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218122f-56e3-4f80-bcc3-e3beb6313e5c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46778777-7adf-4677-b576-d83beb97116a]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flushing IO for device /dev/sdg {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9649a3-0168-4164-9fba-9a33b2905dc7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3c6dd1-0a26-47ff-997d-216a6a5c5323]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] SCSI volumes sdg have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dff398-663f-49bf-9912-0eb62cc6ca33]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67587a45-ad83-49b2-b53f-c686235b5dd5]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260]
Aug 01 17:04:29 user nova-compute[72184]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8, portal: 172.16.0.220,3260] successful.
Aug 01 17:04:29 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-5ae0a388-983f-402a-b3c6-e27560894e20 req-2121df2f-b8ca-4a0d-9d02-ca7eea3641b3 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5ae0a388-983f-402a-b3c6-e27560894e20 req-2121df2f-b8ca-4a0d-9d02-ca7eea3641b3 service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5ae0a388-983f-402a-b3c6-e27560894e20 req-2121df2f-b8ca-4a0d-9d02-ca7eea3641b3 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5ae0a388-983f-402a-b3c6-e27560894e20 req-2121df2f-b8ca-4a0d-9d02-ca7eea3641b3 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-5ae0a388-983f-402a-b3c6-e27560894e20 req-2121df2f-b8ca-4a0d-9d02-ca7eea3641b3 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:29 user nova-compute[72184]: WARNING nova.compute.manager [req-5ae0a388-983f-402a-b3c6-e27560894e20 req-2121df2f-b8ca-4a0d-9d02-ca7eea3641b3 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702dfe35-44fa-40aa-a730-faaedfa48bd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eae4bc-3c5c-48c9-8efd-4aa4ce1df422]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== disconnect_volume: return (290ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:30 user nova-compute[72184]: DEBUG nova.objects.instance [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'flavor' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-11067250-1686-4e0a-8775-dd447e4c9144 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.916s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:31 user nova-compute[72184]: WARNING nova.compute.manager [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:31 user nova-compute[72184]: WARNING nova.compute.manager [req-2825eaad-b497-4b46-8a6d-e8bf0a5d75cb req-22745312-88fd-490e-a58d-ebc61b721a8f service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 90809a35-7659-492d-a605-e3b40e161bbf due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909471.8596303, 90809a35-7659-492d-a605-e3b40e161bbf => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:04:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Resumed (Lifecycle Event)
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-123756e3-5a50-4e72-9a6e-b7d6fe453275 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:04:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909471.8630676, 90809a35-7659-492d-a605-e3b40e161bbf => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:04:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Started (Lifecycle Event)
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:04:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:04:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-changed-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Refreshing instance network info cache due to event network-changed-b15c3c84-1c87-4a8b-a3c5-57b349e24d79. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:04:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] Acquiring lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] Acquired lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Refreshing network info cache for port b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:04:35 user nova-compute[72184]: DEBUG nova.network.neutron [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updated VIF entry in instance network info cache for port b15c3c84-1c87-4a8b-a3c5-57b349e24d79. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:04:35 user nova-compute[72184]: DEBUG nova.network.neutron [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updating instance_info_cache with network_info: [{"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c2e0081a-5db1-479e-b786-20f09e57f412 req-7568d331-3aea-4a86-b941-7de6e7fa88b4 service nova] Releasing lock "refresh_cache-e319b28e-a026-4491-b499-a656711f4c52" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:04:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:38 user nova-compute[72184]: INFO nova.compute.manager [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Attaching volume 07d26c96-05b0-4f0e-a997-3696bc8b71dd to /dev/vdb
Aug 01 17:04:38 user nova-compute[72184]: DEBUG os_brick.utils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e3160-3ab1-4385-a398-421fe4234d74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07afde1a-064e-45e5-8c5d-929bd77acdf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a716eef4-385b-43e4-bc82-cf214c8cee8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebebfb5e-96ac-46ba-b0e2-80e07184ad1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:04:39 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:04:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95717a9-580f-4add-996a-c43c50718cd6]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:04:39 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updating existing volume attachment record: 580bb9f3-b20b-4af0-ae16-7ce1ee0c6d89 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:04:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irglGYEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:04:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:04:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:04:47 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[becd475f-db07-48df-92e5-097ace21da5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:04:47 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d8e41-6048-40cf-839b-bc01698a1ccd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd] added
Aug 01 17:04:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d1c21-1d31-4020-8767-dc08fad3a011]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d99b4b-06fb-452b-b788-c1d6358ec510]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irglGYEt {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irglGYEt" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7f2c09-b399-4495-ba73-14e8cf7b4156]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irglGYEt'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d274e71-2052-4849-89e3-823392a66854]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb590c96-fc7f-4079-be68-03adf783abd4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb7598e-edb8-4b26-97e7-9ccb8de5187f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260]
Aug 01 17:04:47 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260] successful.
Aug 01 17:04:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdbb342-a620-4260-a384-e0ffce10f564]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ee67f2-a339-445c-8052-f47c014f74da]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd (non-flash)
Aug 01 17:04:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:47 user nova-compute[72184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd (non-flash)
Aug 01 17:04:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c3a884-f975-42ab-af14-ed97349c0b31]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:04:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irglGYEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:04:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:04:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23430646534613739', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:04:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430646534613739', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:04:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:04:48 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:04:48 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:04:48 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:04:48 user nova-compute[72184]:   <serial>07d26c96-05b0-4f0e-a997-3696bc8b71dd</serial>
Aug 01 17:04:48 user nova-compute[72184]: </disk>
Aug 01 17:04:48 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:04:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:04:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:04:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] No VIF found with MAC fa:16:3e:2a:b8:aa, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:04:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b420d90-0b67-47b5-b29b-ac2d23996760 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.589s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:50 user nova-compute[72184]: INFO nova.compute.manager [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Detaching volume 07d26c96-05b0-4f0e-a997-3696bc8b71dd
Aug 01 17:04:50 user nova-compute[72184]: INFO nova.virt.block_device [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Attempting to driver detach volume 07d26c96-05b0-4f0e-a997-3696bc8b71dd from mountpoint /dev/vdb
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Attempting to detach device vdb from instance e319b28e-a026-4491-b499-a656711f4c52 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:04:50 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:04:50 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:04:50 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:04:50 user nova-compute[72184]:   <serial>07d26c96-05b0-4f0e-a997-3696bc8b71dd</serial>
Aug 01 17:04:50 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:04:50 user nova-compute[72184]: </disk>
Aug 01 17:04:50 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:04:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully detached device vdb from instance e319b28e-a026-4491-b499-a656711f4c52 from the persistent domain config.
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e319b28e-a026-4491-b499-a656711f4c52 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:04:50 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:04:50 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:04:50 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:04:50 user nova-compute[72184]:   <serial>07d26c96-05b0-4f0e-a997-3696bc8b71dd</serial>
Aug 01 17:04:50 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:04:50 user nova-compute[72184]: </disk>
Aug 01 17:04:50 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909490.597818, e319b28e-a026-4491-b499-a656711f4c52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:04:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully detached device vdb from instance e319b28e-a026-4491-b499-a656711f4c52 from the live domain config.
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irglGYEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:04:50 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[259e0ef2-ae2a-4bf4-96cb-bbabcac392c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05814c9b-f005-4c4a-99c6-f37f149cddec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd (non-flash)
Aug 01 17:04:50 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:04:50 user nova-compute[72184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd (non-flash)
Aug 01 17:04:50 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301830c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[749097e4-f817-452b-b023-3cb8446df7ca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b404a-6d7c-47b3-8815-d08b4f303a6e]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c823534-d7a5-41a2-be59-f87e6725e7d0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e87fa-1b59-4eef-9281-2d004e11b21b]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98633f-01a6-40d6-8e69-eecc2d2aa95b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f0f7d-b1c6-4571-ae46-520858604ad5]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260]
Aug 01 17:04:50 user nova-compute[72184]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd, portal: 172.16.0.220,3260] successful.
Aug 01 17:04:50 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d26c96-05b0-4f0e-a997-3696bc8b71dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c6a665-b119-441c-ae65-34891217b1ff]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] <== disconnect_volume: return (294ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:04:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:04:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'flavor' on Instance uuid e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-693e4ae5-42ec-4e22-ac84-2cadf55764ae tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:04:52 user nova-compute[72184]: INFO nova.compute.claims [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Claim successful on node user
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.policy [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe75ee370f04c89af06c3eb592c585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff6a0fda580e4e6a9ea4e26d30df9e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:04:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Creating image(s)
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "/opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "/opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "/opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk 1073741824" returned: 0 in 0.063s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Cannot resize image /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lazy-loading 'migration_context' on Instance uuid 5caa7061-eba6-4c6c-b72b-f884a074f5c8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Ensure instance console log exists: /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Successfully created port: 253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:04:56 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:04:56 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7052MB free_disk=25.08318328857422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ba84814-1a19-453e-9482-3fae91ae857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e319b28e-a026-4491-b499-a656711f4c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 52833ca5-abaa-44e7-90b1-3e18928101c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5caa7061-eba6-4c6c-b72b-f884a074f5c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Successfully updated port: 253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "refresh_cache-5caa7061-eba6-4c6c-b72b-f884a074f5c8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquired lock "refresh_cache-5caa7061-eba6-4c6c-b72b-f884a074f5c8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-changed-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Refreshing instance network info cache due to event network-changed-253454f2-7b78-4a40-bef3-e9716c28a4c3. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] Acquiring lock "refresh_cache-5caa7061-eba6-4c6c-b72b-f884a074f5c8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.network.neutron [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Updating instance_info_cache with network_info: [{"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Releasing lock "refresh_cache-5caa7061-eba6-4c6c-b72b-f884a074f5c8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Instance network_info: |[{"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] Acquired lock "refresh_cache-5caa7061-eba6-4c6c-b72b-f884a074f5c8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Refreshing network info cache for port 253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Start _get_guest_xml network_info=[{"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:04:57 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:04:57 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-545995869',display_name='tempest-VolumesActionsTest-instance-545995869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-545995869',id=32,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff6a0fda580e4e6a9ea4e26d30df9e67',ramdisk_id='',reservation_id='r-57iwdv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-197584980',owner_user_name='tempest-VolumesActionsTest-197584980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:04:54Z,user_data=None,user_id='8fe75ee370f04c89af06c3eb592c585a',uuid=5caa7061-eba6-4c6c-b72b-f884a074f5c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converting VIF {"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lazy-loading 'pci_devices' on Instance uuid 5caa7061-eba6-4c6c-b72b-f884a074f5c8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:04:57 user nova-compute[72184]:   <uuid>5caa7061-eba6-4c6c-b72b-f884a074f5c8</uuid>
Aug 01 17:04:57 user nova-compute[72184]:   <name>instance-00000020</name>
Aug 01 17:04:57 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:04:57 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:04:57 user nova-compute[72184]:   <metadata>
Aug 01 17:04:57 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:04:57 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:04:57 user nova-compute[72184]:       <nova:name>tempest-VolumesActionsTest-instance-545995869</nova:name>
Aug 01 17:04:57 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:04:57</nova:creationTime>
Aug 01 17:04:57 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:04:57 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:04:57 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:04:57 user nova-compute[72184]:       <nova:owner>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:user uuid="8fe75ee370f04c89af06c3eb592c585a">tempest-VolumesActionsTest-197584980-project-member</nova:user>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:project uuid="ff6a0fda580e4e6a9ea4e26d30df9e67">tempest-VolumesActionsTest-197584980</nova:project>
Aug 01 17:04:57 user nova-compute[72184]:       </nova:owner>
Aug 01 17:04:57 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:04:57 user nova-compute[72184]:       <nova:ports>
Aug 01 17:04:57 user nova-compute[72184]:         <nova:port uuid="253454f2-7b78-4a40-bef3-e9716c28a4c3">
Aug 01 17:04:57 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:04:57 user nova-compute[72184]:         </nova:port>
Aug 01 17:04:57 user nova-compute[72184]:       </nova:ports>
Aug 01 17:04:57 user nova-compute[72184]:     </nova:instance>
Aug 01 17:04:57 user nova-compute[72184]:   </metadata>
Aug 01 17:04:57 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:04:57 user nova-compute[72184]:     <system>
Aug 01 17:04:57 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:04:57 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:04:57 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:04:57 user nova-compute[72184]:       <entry name="serial">5caa7061-eba6-4c6c-b72b-f884a074f5c8</entry>
Aug 01 17:04:57 user nova-compute[72184]:       <entry name="uuid">5caa7061-eba6-4c6c-b72b-f884a074f5c8</entry>
Aug 01 17:04:57 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:04:57 user nova-compute[72184]:     </system>
Aug 01 17:04:57 user nova-compute[72184]:   </sysinfo>
Aug 01 17:04:57 user nova-compute[72184]:   <os>
Aug 01 17:04:57 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:04:57 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:04:57 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:04:57 user nova-compute[72184]:   </os>
Aug 01 17:04:57 user nova-compute[72184]:   <features>
Aug 01 17:04:57 user nova-compute[72184]:     <acpi/>
Aug 01 17:04:57 user nova-compute[72184]:     <apic/>
Aug 01 17:04:57 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:04:57 user nova-compute[72184]:   </features>
Aug 01 17:04:57 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:04:57 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:04:57 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:04:57 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:04:57 user nova-compute[72184]:   </clock>
Aug 01 17:04:57 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:04:57 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:04:57 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:04:57 user nova-compute[72184]:   </cpu>
Aug 01 17:04:57 user nova-compute[72184]:   <devices>
Aug 01 17:04:57 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:04:57 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:04:57 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk"/>
Aug 01 17:04:57 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:04:57 user nova-compute[72184]:     </disk>
Aug 01 17:04:57 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:04:57 user nova-compute[72184]:       <mac address="fa:16:3e:78:0a:c5"/>
Aug 01 17:04:57 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:04:57 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:04:57 user nova-compute[72184]:       <target dev="tap253454f2-7b"/>
Aug 01 17:04:57 user nova-compute[72184]:     </interface>
Aug 01 17:04:57 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:04:57 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/console.log" append="off"/>
Aug 01 17:04:57 user nova-compute[72184]:     </serial>
Aug 01 17:04:57 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:04:57 user nova-compute[72184]:     <video>
Aug 01 17:04:57 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:04:57 user nova-compute[72184]:     </video>
Aug 01 17:04:57 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:04:57 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:04:57 user nova-compute[72184]:     </rng>
Aug 01 17:04:57 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:04:57 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:04:57 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:04:57 user nova-compute[72184]:     </memballoon>
Aug 01 17:04:57 user nova-compute[72184]:   </devices>
Aug 01 17:04:57 user nova-compute[72184]: </domain>
Aug 01 17:04:57 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-545995869',display_name='tempest-VolumesActionsTest-instance-545995869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-545995869',id=32,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff6a0fda580e4e6a9ea4e26d30df9e67',ramdisk_id='',reservation_id='r-57iwdv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-197584980',owner_user_name='tempest-VolumesActionsTest-197584980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:04:54Z,user_data=None,user_id='8fe75ee370f04c89af06c3eb592c585a',uuid=5caa7061-eba6-4c6c-b72b-f884a074f5c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converting VIF {"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG os_vif [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap253454f2-7b, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap253454f2-7b, col_values=(('external_ids', {'iface-id': '253454f2-7b78-4a40-bef3-e9716c28a4c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0a:c5', 'vm-uuid': '5caa7061-eba6-4c6c-b72b-f884a074f5c8'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:57 user nova-compute[72184]: INFO os_vif [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b')
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] No VIF found with MAC fa:16:3e:78:0a:c5, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'flavor' on Instance uuid 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:04:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Ignoring supplied device name: /dev/vdb
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Updated VIF entry in instance network info cache for port 253454f2-7b78-4a40-bef3-e9716c28a4c3. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Updating instance_info_cache with network_info: [{"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e12124b8-17b3-4f68-a09a-2555ab68851e req-fc81cd2a-1dee-4991-a8e0-fa23d56f877c service nova] Releasing lock "refresh_cache-5caa7061-eba6-4c6c-b72b-f884a074f5c8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:58 user nova-compute[72184]: INFO nova.compute.manager [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Attaching volume 24e4232f-5415-44e1-96ee-aa706d1f1396 to /dev/vdb
Aug 01 17:04:58 user nova-compute[72184]: DEBUG os_brick.utils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b841210-860e-4582-8316-897eb0baef8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4c76c-ce23-4586-9668-aa21f3b4cbed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d560169e-2050-481a-b98c-83d1b4b2191a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caeb4ec-ccfd-452a-9ef2-8cee9e5a2f5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:04:58 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d1830-b5b0-4af4-91e5-40eda128b08f]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG os_brick.utils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updating existing volume attachment record: bdcc0afb-7806-476f-b2b1-0b7c183c7980 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-changed-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Refreshing instance network info cache due to event network-changed-0d80e567-4050-47d5-b182-dcee05862e6e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] Acquiring lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] Acquired lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Refreshing network info cache for port 0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-821c3eca-f4b7-4f5a-8d99-1a4f21658b85 req-2fadb86b-70fc-4895-9651-51042762a6db service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-821c3eca-f4b7-4f5a-8d99-1a4f21658b85 req-2fadb86b-70fc-4895-9651-51042762a6db service nova] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-821c3eca-f4b7-4f5a-8d99-1a4f21658b85 req-2fadb86b-70fc-4895-9651-51042762a6db service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-821c3eca-f4b7-4f5a-8d99-1a4f21658b85 req-2fadb86b-70fc-4895-9651-51042762a6db service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-821c3eca-f4b7-4f5a-8d99-1a4f21658b85 req-2fadb86b-70fc-4895-9651-51042762a6db service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] No waiting events found dispatching network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:04:59 user nova-compute[72184]: WARNING nova.compute.manager [req-821c3eca-f4b7-4f5a-8d99-1a4f21658b85 req-2fadb86b-70fc-4895-9651-51042762a6db service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received unexpected event network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 for instance with vm_state building and task_state spawning.
Aug 01 17:04:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updated VIF entry in instance network info cache for port 0d80e567-4050-47d5-b182-dcee05862e6e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG nova.network.neutron [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updating instance_info_cache with network_info: [{"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:04:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-32dd852d-5e1b-4f05-8bee-9f1a86e6008a req-02d70496-1e6c-4f4c-bc75-404a25fd561f service nova] Releasing lock "refresh_cache-2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [{"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-1ba84814-1a19-453e-9482-3fae91ae857d" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:00 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909501.4214933, 5caa7061-eba6-4c6c-b72b-f884a074f5c8 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] VM Resumed (Lifecycle Event)
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Instance spawned successfully.
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909501.4234695, 5caa7061-eba6-4c6c-b72b-f884a074f5c8 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] VM Started (Lifecycle Event)
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e71ab72-5bbb-4b9a-a17b-f32bb9c52cae req-1732fd06-f391-4c3b-9db2-f4cd4832d097 service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e71ab72-5bbb-4b9a-a17b-f32bb9c52cae req-1732fd06-f391-4c3b-9db2-f4cd4832d097 service nova] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e71ab72-5bbb-4b9a-a17b-f32bb9c52cae req-1732fd06-f391-4c3b-9db2-f4cd4832d097 service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e71ab72-5bbb-4b9a-a17b-f32bb9c52cae req-1732fd06-f391-4c3b-9db2-f4cd4832d097 service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e71ab72-5bbb-4b9a-a17b-f32bb9c52cae req-1732fd06-f391-4c3b-9db2-f4cd4832d097 service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] No waiting events found dispatching network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:01 user nova-compute[72184]: WARNING nova.compute.manager [req-2e71ab72-5bbb-4b9a-a17b-f32bb9c52cae req-1732fd06-f391-4c3b-9db2-f4cd4832d097 service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received unexpected event network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 for instance with vm_state building and task_state spawning.
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Took 7.78 seconds to spawn the instance on the hypervisor.
Aug 01 17:05:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:01 user nova-compute[72184]: INFO nova.compute.manager [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Took 8.95 seconds to build instance.
Aug 01 17:05:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4dacf43-204f-403f-9f61-c1cba73ee71f tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.060s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAairTmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:06 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:06 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:06 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[490bcc75-f32d-4714-bb28-689513af9613]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:05:06 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8191cb1-7bd9-464a-a8f2-264127e93b29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396] added
Aug 01 17:05:06 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef707c-5b13-4a25-8085-412a7c56093a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48aa3b-4efe-404e-9d59-96b32000ec27]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAairTmF {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAairTmF" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4deaf3-a88f-4bd8-a17b-87f1708c7b3e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QAairTmF'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[033c3985-68b1-4efa-8ec0-ddba12811fcb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce25af2-30d8-4606-880a-5633e25c1f1a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:07 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:07 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7626fa-5e3d-4ff9-8cee-497794b5ab93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260]
Aug 01 17:05:07 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260] successful.
Aug 01 17:05:07 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[39953023-fc24-497e-8e50-8d1409b8f833]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cca92e-bab1-41c6-a8cb-a85aff82c035]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:07 user nova-compute[72184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)
Aug 01 17:05:07 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d315549c-c220-4c6b-b2a7-e8efefe4da09]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAairTmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:05:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23939663430393539', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939663430393539', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'flavor' on Instance uuid 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:05:08 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:05:08 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:05:08 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:05:08 user nova-compute[72184]:   <serial>24e4232f-5415-44e1-96ee-aa706d1f1396</serial>
Aug 01 17:05:08 user nova-compute[72184]: </disk>
Aug 01 17:05:08 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No VIF found with MAC fa:16:3e:6c:b4:f3, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:05:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e1090c66-c717-4d3c-9606-7c89e21a5380 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.657s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:21 user nova-compute[72184]: INFO nova.compute.manager [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Rescuing
Aug 01 17:05:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:05:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:05:21 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updating instance_info_cache with network_info: [{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-c7760f56-c786-42fe-baab-1c14bab7fe09 req-4e2f0a4b-bfdb-4c64-8800-fb89c9bae278 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c7760f56-c786-42fe-baab-1c14bab7fe09 req-4e2f0a4b-bfdb-4c64-8800-fb89c9bae278 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c7760f56-c786-42fe-baab-1c14bab7fe09 req-4e2f0a4b-bfdb-4c64-8800-fb89c9bae278 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c7760f56-c786-42fe-baab-1c14bab7fe09 req-4e2f0a4b-bfdb-4c64-8800-fb89c9bae278 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-c7760f56-c786-42fe-baab-1c14bab7fe09 req-4e2f0a4b-bfdb-4c64-8800-fb89c9bae278 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:22 user nova-compute[72184]: WARNING nova.compute.manager [req-c7760f56-c786-42fe-baab-1c14bab7fe09 req-4e2f0a4b-bfdb-4c64-8800-fb89c9bae278 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state active and task_state rescuing.
Aug 01 17:05:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance destroyed successfully.
Aug 01 17:05:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Attempting a stable device rescue
Aug 01 17:05:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 17:05:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 17:05:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Creating image(s)
Aug 01 17:05:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "/opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "/opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:23 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "9ddd560259fd173a322406f7be6ebcdad2056796" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "9ddd560259fd173a322406f7be6ebcdad2056796" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG nova.virt.images [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] 2ad2bebb-f30e-4ca2-9236-144cffbdd388 was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.part /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.part /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.converted" returned: 0 in 0.408s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-9037255b-dad2-43d4-a8a1-265587894cf3 req-54eea31a-31ca-4005-b7d3-2afa05e73a66 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9037255b-dad2-43d4-a8a1-265587894cf3 req-54eea31a-31ca-4005-b7d3-2afa05e73a66 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9037255b-dad2-43d4-a8a1-265587894cf3 req-54eea31a-31ca-4005-b7d3-2afa05e73a66 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9037255b-dad2-43d4-a8a1-265587894cf3 req-54eea31a-31ca-4005-b7d3-2afa05e73a66 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-9037255b-dad2-43d4-a8a1-265587894cf3 req-54eea31a-31ca-4005-b7d3-2afa05e73a66 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:24 user nova-compute[72184]: WARNING nova.compute.manager [req-9037255b-dad2-43d4-a8a1-265587894cf3 req-54eea31a-31ca-4005-b7d3-2afa05e73a66 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state active and task_state rescuing.
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "9ddd560259fd173a322406f7be6ebcdad2056796" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.676s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "9ddd560259fd173a322406f7be6ebcdad2056796" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "9ddd560259fd173a322406f7be6ebcdad2056796" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796,backing_fmt=raw /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796,backing_fmt=raw /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue" returned: 0 in 0.051s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "9ddd560259fd173a322406f7be6ebcdad2056796" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'migration_context' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Start _get_guest_xml network_info=[{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "vif_mac": "fa:16:3e:fc:5b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ad2bebb-f30e-4ca2-9236-144cffbdd388', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '21c38bf8-f160-444b-bc55-fce962e0eb0d', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '52833ca5-abaa-44e7-90b1-3e18928101c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed70de59-236b-495b-a329-0fcd626c77dd', 'serial': 'ed70de59-236b-495b-a329-0fcd626c77dd'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'resources' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'numa_topology' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:25 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:05:25 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:25 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:25 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:25 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a759c589-fe72-45d7-89bb-a03fdffa538f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OpazWRjU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 17:05:25 user nova-compute[72184]: node.name = iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd
Aug 01 17:05:25 user nova-compute[72184]: node.tpgt = -1
Aug 01 17:05:25 user nova-compute[72184]: node.startup = automatic
Aug 01 17:05:25 user nova-compute[72184]: node.leading_login = No
Aug 01 17:05:25 user nova-compute[72184]: iface.iscsi_ifacename = default
Aug 01 17:05:25 user nova-compute[72184]: iface.net_ifacename = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.ipaddress = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.prefix_len = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.hwaddress = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.transport_name = tcp
Aug 01 17:05:25 user nova-compute[72184]: iface.initiatorname = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.vlan_id = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.vlan_priority = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.vlan_state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.iface_num = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.mtu = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.port = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.bootproto = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.subnet_mask = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.gateway = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_alt_client_id = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_dns = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_learn_iqn = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_vendor_id_state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_vendor_id = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.dhcp_slp_da = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.fragmentation = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.gratuitous_arp = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.incoming_forwarding = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.tos_state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.tos = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.ttl = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.delayed_ack = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.tcp_nagle = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.tcp_wsf_state = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.tcp_wsf = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.tcp_timer_scale = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.tcp_timestamp = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.redirect = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.def_task_mgmt_timeout = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.header_digest = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.data_digest = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.immediate_data = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.initial_r2t = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.data_seq_inorder = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.data_pdu_inorder = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.erl = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.max_receive_data_len = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.first_burst_len = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.max_outstanding_r2t = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.max_burst_len = 0
Aug 01 17:05:25 user nova-compute[72184]: iface.chap_auth = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.bidi_chap = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.strict_login_compliance = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.discovery_auth = <empty>
Aug 01 17:05:25 user nova-compute[72184]: iface.discovery_logout = <empty>
Aug 01 17:05:25 user nova-compute[72184]: node.discovery_address = <empty>
Aug 01 17:05:25 user nova-compute[72184]: node.discovery_port = 0
Aug 01 17:05:25 user nova-compute[72184]: node.discovery_type = static
Aug 01 17:05:25 user nova-compute[72184]: node.session.initial_cmdsn = 0
Aug 01 17:05:25 user nova-compute[72184]: node.session.initial_login_retry_max = 8
Aug 01 17:05:25 user nova-compute[72184]: node.session.xmit_thread_priority = -20
Aug 01 17:05:25 user nova-compute[72184]: node.session.cmds_max = 128
Aug 01 17:05:25 user nova-compute[72184]: node.session.queue_depth = 32
Aug 01 17:05:25 user nova-compute[72184]: node.session.nr_sessions = 1
Aug 01 17:05:25 user nova-compute[72184]: node.session.auth.authmethod = CHAP
Aug 01 17:05:25 user nova-compute[72184]: node.session.auth.username = OpazWRjU
Aug 01 17:05:25 user nova-compute[72184]: node.session.auth.password = ***
Aug 01 17:05:25 user nova-compute[72184]: node.session.auth.username_in = <empty>
Aug 01 17:05:25 user nova-compute[72184]: node.session.auth.password_in = <empty>
Aug 01 17:05:25 user nova-compute[72184]: node.session.auth.chap_algs = MD5
Aug 01 17:05:25 user nova-compute[72184]: node.session.timeo.replacement_timeout = 120
Aug 01 17:05:25 user nova-compute[72184]: node.session.err_timeo.abort_timeout = 15
Aug 01 17:05:25 user nova-compute[72184]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 17:05:25 user nova-compute[72184]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 17:05:25 user nova-compute[72184]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.FastAbort = Yes
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.InitialR2T = No
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.ImmediateData = Yes
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.MaxConnections = 1
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 17:05:25 user nova-compute[72184]: node.session.iscsi.ERL = 0
Aug 01 17:05:25 user nova-compute[72184]: node.session.scan = manual
Aug 01 17:05:25 user nova-compute[72184]: node.session.reopen_max = 0
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].address = 172.16.0.220
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].port = 3260
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].startup = manual
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].tcp.window_size = 524288
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].tcp.type_of_service = 0
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].timeo.logout_timeout = 15
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].timeo.login_timeout = 15
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].timeo.auth_timeout = 45
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].iscsi.DataDigest = None
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].iscsi.IFMarker = No
Aug 01 17:05:25 user nova-compute[72184]: node.conn[0].iscsi.OFMarker = No
Aug 01 17:05:25 user nova-compute[72184]: # END RECORD
Aug 01 17:05:25 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bab771-1084-4fcb-af5f-05832e5e0edf]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88651e23-36f0-4fea-b6c2-02f6dbdba068]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpazWRjU {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpazWRjU" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33722828-cd04-44ba-ba52-b88442269711]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpazWRjU'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86153b1c-91a3-467f-91eb-b26e05b0fefb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500b047-2dc8-4f7a-8ea4-2ce381522622]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)
Aug 01 17:05:25 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:25 user nova-compute[72184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)
Aug 01 17:05:25 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] HCTL ('34', '0', '0', 0) found on session 33 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8151d6-e6d1-4647-bf98-8a63dbe28a40]: (4, ('0 0 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Searching for a device in session 33 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== connect_volume: return (192ms) {'type': 'block', 'scsi_wwn': '23962393665343737', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962393665343737', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1665417027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1665417027',id=30,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:03:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-znime3vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:03:59Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=52833ca5-abaa-44e7-90b1-3e18928101c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "vif_mac": "fa:16:3e:fc:5b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "vif_mac": "fa:16:3e:fc:5b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'pci_devices' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:05:25 user nova-compute[72184]:   <uuid>52833ca5-abaa-44e7-90b1-3e18928101c2</uuid>
Aug 01 17:05:25 user nova-compute[72184]:   <name>instance-0000001e</name>
Aug 01 17:05:25 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:05:25 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:05:25 user nova-compute[72184]:   <metadata>
Aug 01 17:05:25 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:05:25 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:05:25 user nova-compute[72184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1665417027</nova:name>
Aug 01 17:05:25 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:05:25</nova:creationTime>
Aug 01 17:05:25 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:05:25 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:05:25 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:05:25 user nova-compute[72184]:       <nova:owner>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:user uuid="1b9ae86640754099bb01c48a6807075f">tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member</nova:user>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:project uuid="b13772bce6fa482189f819cb065170b3">tempest-ServerBootFromVolumeStableRescueTest-388641611</nova:project>
Aug 01 17:05:25 user nova-compute[72184]:       </nova:owner>
Aug 01 17:05:25 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:05:25 user nova-compute[72184]:       <nova:ports>
Aug 01 17:05:25 user nova-compute[72184]:         <nova:port uuid="732c42b3-c7fa-46d8-aa0f-fea08031e568">
Aug 01 17:05:25 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:05:25 user nova-compute[72184]:         </nova:port>
Aug 01 17:05:25 user nova-compute[72184]:       </nova:ports>
Aug 01 17:05:25 user nova-compute[72184]:     </nova:instance>
Aug 01 17:05:25 user nova-compute[72184]:   </metadata>
Aug 01 17:05:25 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:05:25 user nova-compute[72184]:     <system>
Aug 01 17:05:25 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:05:25 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:05:25 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:05:25 user nova-compute[72184]:       <entry name="serial">52833ca5-abaa-44e7-90b1-3e18928101c2</entry>
Aug 01 17:05:25 user nova-compute[72184]:       <entry name="uuid">52833ca5-abaa-44e7-90b1-3e18928101c2</entry>
Aug 01 17:05:25 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:05:25 user nova-compute[72184]:     </system>
Aug 01 17:05:25 user nova-compute[72184]:   </sysinfo>
Aug 01 17:05:25 user nova-compute[72184]:   <os>
Aug 01 17:05:25 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:05:25 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:05:25 user nova-compute[72184]:   </os>
Aug 01 17:05:25 user nova-compute[72184]:   <features>
Aug 01 17:05:25 user nova-compute[72184]:     <acpi/>
Aug 01 17:05:25 user nova-compute[72184]:     <apic/>
Aug 01 17:05:25 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:05:25 user nova-compute[72184]:   </features>
Aug 01 17:05:25 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:05:25 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:05:25 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:05:25 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:05:25 user nova-compute[72184]:   </clock>
Aug 01 17:05:25 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:05:25 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:05:25 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:05:25 user nova-compute[72184]:   </cpu>
Aug 01 17:05:25 user nova-compute[72184]:   <devices>
Aug 01 17:05:25 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:05:25 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:05:25 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:05:25 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:05:25 user nova-compute[72184]:       <serial>ed70de59-236b-495b-a329-0fcd626c77dd</serial>
Aug 01 17:05:25 user nova-compute[72184]:     </disk>
Aug 01 17:05:25 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:05:25 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:05:25 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue"/>
Aug 01 17:05:25 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:05:25 user nova-compute[72184]:       <boot order="1"/>
Aug 01 17:05:25 user nova-compute[72184]:     </disk>
Aug 01 17:05:25 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:05:25 user nova-compute[72184]:       <mac address="fa:16:3e:fc:5b:a4"/>
Aug 01 17:05:25 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:05:25 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:05:25 user nova-compute[72184]:       <target dev="tap732c42b3-c7"/>
Aug 01 17:05:25 user nova-compute[72184]:     </interface>
Aug 01 17:05:25 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:05:25 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/console.log" append="off"/>
Aug 01 17:05:25 user nova-compute[72184]:     </serial>
Aug 01 17:05:25 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:05:25 user nova-compute[72184]:     <video>
Aug 01 17:05:25 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:05:25 user nova-compute[72184]:     </video>
Aug 01 17:05:25 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:05:25 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:05:25 user nova-compute[72184]:     </rng>
Aug 01 17:05:25 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:05:25 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:05:25 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:05:25 user nova-compute[72184]:     </memballoon>
Aug 01 17:05:25 user nova-compute[72184]:   </devices>
Aug 01 17:05:25 user nova-compute[72184]: </domain>
Aug 01 17:05:25 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:05:25 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance destroyed successfully.
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:05:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] No VIF found with MAC fa:16:3e:fc:5b:a4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:05:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-75c7b541-8878-4c3b-8532-1636bdda91c6 req-f59a2311-cb93-46c1-96d5-bc9a48469fb9 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-75c7b541-8878-4c3b-8532-1636bdda91c6 req-f59a2311-cb93-46c1-96d5-bc9a48469fb9 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-75c7b541-8878-4c3b-8532-1636bdda91c6 req-f59a2311-cb93-46c1-96d5-bc9a48469fb9 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-75c7b541-8878-4c3b-8532-1636bdda91c6 req-f59a2311-cb93-46c1-96d5-bc9a48469fb9 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-75c7b541-8878-4c3b-8532-1636bdda91c6 req-f59a2311-cb93-46c1-96d5-bc9a48469fb9 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:27 user nova-compute[72184]: WARNING nova.compute.manager [req-75c7b541-8878-4c3b-8532-1636bdda91c6 req-f59a2311-cb93-46c1-96d5-bc9a48469fb9 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state active and task_state rescuing.
Aug 01 17:05:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 52833ca5-abaa-44e7-90b1-3e18928101c2 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 17:05:28 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909528.9600954, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:28 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Resumed (Lifecycle Event)
Aug 01 17:05:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7451645d-083f-4bd0-821b-3dd46f1e6789 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:05:29 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 17:05:29 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909528.9612741, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:29 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Started (Lifecycle Event)
Aug 01 17:05:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:05:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-7fd4a3b0-0edb-44ed-85d0-373994dd186f req-6eb0da8d-b522-4d3f-974a-b85f3a68e43a service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7fd4a3b0-0edb-44ed-85d0-373994dd186f req-6eb0da8d-b522-4d3f-974a-b85f3a68e43a service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7fd4a3b0-0edb-44ed-85d0-373994dd186f req-6eb0da8d-b522-4d3f-974a-b85f3a68e43a service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7fd4a3b0-0edb-44ed-85d0-373994dd186f req-6eb0da8d-b522-4d3f-974a-b85f3a68e43a service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-7fd4a3b0-0edb-44ed-85d0-373994dd186f req-6eb0da8d-b522-4d3f-974a-b85f3a68e43a service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:29 user nova-compute[72184]: WARNING nova.compute.manager [req-7fd4a3b0-0edb-44ed-85d0-373994dd186f req-6eb0da8d-b522-4d3f-974a-b85f3a68e43a service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state rescued and task_state None.
Aug 01 17:05:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:35 user nova-compute[72184]: INFO nova.compute.manager [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Detaching volume 24e4232f-5415-44e1-96ee-aa706d1f1396
Aug 01 17:05:35 user nova-compute[72184]: INFO nova.virt.block_device [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Attempting to driver detach volume 24e4232f-5415-44e1-96ee-aa706d1f1396 from mountpoint /dev/vdb
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Attempting to detach device vdb from instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:05:35 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:05:35 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:05:35 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:05:35 user nova-compute[72184]:   <serial>24e4232f-5415-44e1-96ee-aa706d1f1396</serial>
Aug 01 17:05:35 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:05:35 user nova-compute[72184]: </disk>
Aug 01 17:05:35 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:05:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully detached device vdb from instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 from the persistent domain config.
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:05:35 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:05:35 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:05:35 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:05:35 user nova-compute[72184]:   <serial>24e4232f-5415-44e1-96ee-aa706d1f1396</serial>
Aug 01 17:05:35 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:05:35 user nova-compute[72184]: </disk>
Aug 01 17:05:35 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909535.6192813, 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:05:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully detached device vdb from instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 from the live domain config.
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAairTmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:35 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[606ffa1c-f776-4a40-b4ff-eba47d344e9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[140124a1-19b8-4a7b-be83-dd1349f6eeaa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)
Aug 01 17:05:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:35 user nova-compute[72184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 (non-flash)
Aug 01 17:05:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12204fda-8f24-412e-b7b2-ada4ae0b35b0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f909396-acf6-4ee1-a034-81c844e366e0]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e63bf-71e6-4f1a-a660-90f85effe669]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31566e5-f45c-473a-be31-757fc099d62c]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53ebc4-7fd5-43bc-b31b-cab7d6ca8c2b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b4008b-812c-411f-ae11-5ed8a49cd4ea]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260]
Aug 01 17:05:35 user nova-compute[72184]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396, portal: 172.16.0.220,3260] successful.
Aug 01 17:05:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292ab90-eea8-4eb2-a6b1-08faf26d3e1a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== disconnect_volume: return (287ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'flavor' on Instance uuid 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-5a957611-b027-4b52-a421-6be4a0f2cb90 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.599s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:36 user nova-compute[72184]: INFO nova.compute.manager [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Terminating instance
Aug 01 17:05:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-14c3b900-3d95-4df7-a656-7a0ee7f4b003 req-4cad7018-48b6-4f54-ae67-34d0ae03930c service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-vif-unplugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-14c3b900-3d95-4df7-a656-7a0ee7f4b003 req-4cad7018-48b6-4f54-ae67-34d0ae03930c service nova] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-14c3b900-3d95-4df7-a656-7a0ee7f4b003 req-4cad7018-48b6-4f54-ae67-34d0ae03930c service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-14c3b900-3d95-4df7-a656-7a0ee7f4b003 req-4cad7018-48b6-4f54-ae67-34d0ae03930c service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-14c3b900-3d95-4df7-a656-7a0ee7f4b003 req-4cad7018-48b6-4f54-ae67-34d0ae03930c service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] No waiting events found dispatching network-vif-unplugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-14c3b900-3d95-4df7-a656-7a0ee7f4b003 req-4cad7018-48b6-4f54-ae67-34d0ae03930c service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-vif-unplugged-0d80e567-4050-47d5-b182-dcee05862e6e for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:05:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Instance destroyed successfully.
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'resources' on Instance uuid 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1484862329',display_name='tempest-VolumesSnapshotTestJSON-instance-1484862329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1484862329',id=29,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhdVDlwCW92Zom7Jl8YzO6S8jOZh5dU7DBSOfWCFTBuDVZWKA050AsNMUPcSdKoGXvbW6v5qfTbtQY/8VEiDFwKcScXV4GgQZ5OAmu0uclp6uIJhxGM9YMHLIuaN8jHpQ==',key_name='tempest-keypair-1684229642',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bb72853e93848b6995582327cd53b9a',ramdisk_id='',reservation_id='r-idvtryjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-785628539',owner_user_name='tempest-VolumesSnapshotTestJSON-785628539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0c8a60b3824038802bc7bb2298988f',uuid=2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converting VIF {"id": "0d80e567-4050-47d5-b182-dcee05862e6e", "address": "fa:16:3e:6c:b4:f3", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d80e567-40", "ovs_interfaceid": "0d80e567-4050-47d5-b182-dcee05862e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_vif [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d80e567-40, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:05:37 user nova-compute[72184]: INFO os_vif [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b4:f3,bridge_name='br-int',has_traffic_filtering=True,id=0d80e567-4050-47d5-b182-dcee05862e6e,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d80e567-40')
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAairTmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:37 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24e4232f-5415-44e1-96ee-aa706d1f1396', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0d001-fdfb-4317-9191-1814738f1f64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b87684-9231-4457-97e7-1dfb5d897f85]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:37 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:37 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:37 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:37 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:37 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:37 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:37 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867c430>, {}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Disconnecting from: [] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== disconnect_volume: return (52ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:05:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Deleting instance files /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8_del
Aug 01 17:05:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Deletion of /opt/stack/data/nova/instances/2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8_del complete
Aug 01 17:05:37 user nova-compute[72184]: INFO nova.compute.manager [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 01 17:05:37 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:05:37 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:38 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Took 0.75 seconds to deallocate network for instance.
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-41af2b57-67bb-46ca-b8a9-e8e63df7e86a req-02da971b-db26-4dad-ab5c-942e97750d21 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-vif-deleted-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:38 user nova-compute[72184]: INFO nova.compute.manager [req-41af2b57-67bb-46ca-b8a9-e8e63df7e86a req-02da971b-db26-4dad-ab5c-942e97750d21 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Neutron deleted interface 0d80e567-4050-47d5-b182-dcee05862e6e; detaching it from the instance and deleting it from the info cache
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.network.neutron [req-41af2b57-67bb-46ca-b8a9-e8e63df7e86a req-02da971b-db26-4dad-ab5c-942e97750d21 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-41af2b57-67bb-46ca-b8a9-e8e63df7e86a req-02da971b-db26-4dad-ab5c-942e97750d21 service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Detach interface failed, port_id=0d80e567-4050-47d5-b182-dcee05862e6e, reason: Instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:05:38 user nova-compute[72184]: WARNING nova.volume.cinder [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Attachment bdcc0afb-7806-476f-b2b1-0b7c183c7980 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bdcc0afb-7806-476f-b2b1-0b7c183c7980. (HTTP 404) (Request-ID: req-a436bc49-21b3-441f-89e0-5845520671b4)
Aug 01 17:05:38 user nova-compute[72184]: INFO nova.compute.manager [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Took 0.03 seconds to detach 1 volumes for instance.
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:38 user nova-compute[72184]: INFO nova.compute.manager [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Terminating instance
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:05:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:38 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Deleted allocations for instance 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7b75f287-92fa-4f4a-9109-bc1ab79bf8d2 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.323s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received event network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] Acquiring lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] Lock "2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] No waiting events found dispatching network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:39 user nova-compute[72184]: WARNING nova.compute.manager [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Received unexpected event network-vif-plugged-0d80e567-4050-47d5-b182-dcee05862e6e for instance with vm_state deleted and task_state None.
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-e7f98524-5719-4344-97e8-4c6d9ae240a5 req-eea948ce-4ef3-4969-b036-02c37918bafd service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-unplugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:05:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Instance destroyed successfully.
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lazy-loading 'resources' on Instance uuid 1ba84814-1a19-453e-9482-3fae91ae857d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1980360680',display_name='tempest-ServerActionsTestOtherB-server-1980360680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1980360680',id=19,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzF3QRYd8eiwYEHySfAGcvBWsbDHVTiscnjq9i4BoLAd0DkL1yO5bSC4DQst8yJvRPEfOVgsiQte9buUBmJjhWXFuZh3I9p2L7mGsISAg9ilqPuu5JbT4aA+uE7lXJpg==',key_name='tempest-keypair-1019259791',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='955f909d63034bc8ace106364f8d9b96',ramdisk_id='',reservation_id='r-z9hgenei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1303337288',owner_user_name='tempest-ServerActionsTestOtherB-1303337288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cb37dea792d4fc98ac32d9c282020d6',uuid=1ba84814-1a19-453e-9482-3fae91ae857d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converting VIF {"id": "fc02a82f-c678-49e6-8196-5213ef90e225", "address": "fa:16:3e:0f:89:fd", "network": {"id": "5d7e729e-97d9-43f4-975f-b29cef4ffc1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-727576488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "955f909d63034bc8ace106364f8d9b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc02a82f-c6", "ovs_interfaceid": "fc02a82f-c678-49e6-8196-5213ef90e225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_vif [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc02a82f-c6, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:05:39 user nova-compute[72184]: INFO os_vif [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=fc02a82f-c678-49e6-8196-5213ef90e225,network=Network(5d7e729e-97d9-43f4-975f-b29cef4ffc1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc02a82f-c6')
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgJFEoNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:39 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b9165e-3a44-43ce-876b-bd0fded5e090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[312a17d8-c30f-4cd5-9690-6ccca8d7187f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:39 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:39 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:39 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:39 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:39 user nova-compute[72184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 (non-flash)
Aug 01 17:05:39 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301c4d27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[782fe308-2337-4776-aa63-bb2fb9719bf2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3a02f6-f400-4101-8ab7-58a1dc6c1935]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edf77f0-7123-4823-93fd-c0f5d722289c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a6740d-aef1-47fe-bb73-588033d81da4]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[605dce52-0ebc-4192-a7fc-1a77502a1e93]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe3edc2-daca-4ead-b807-2527e8a43aa6]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260]
Aug 01 17:05:39 user nova-compute[72184]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5, portal: 172.16.0.220,3260] successful.
Aug 01 17:05:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe74796-b077-4ffd-ad2f-275538862cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5bc5b-c2b6-4675-9d11-f786f8cab7d4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] <== disconnect_volume: return (292ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:05:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Deleting instance files /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d_del
Aug 01 17:05:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Deletion of /opt/stack/data/nova/instances/1ba84814-1a19-453e-9482-3fae91ae857d_del complete
Aug 01 17:05:39 user nova-compute[72184]: INFO nova.compute.manager [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 17:05:39 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:05:39 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:40 user nova-compute[72184]: INFO nova.compute.manager [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Terminating instance
Aug 01 17:05:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Acquiring lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Lock "1ba84814-1a19-453e-9482-3fae91ae857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] No waiting events found dispatching network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:41 user nova-compute[72184]: WARNING nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received unexpected event network-vif-plugged-fc02a82f-c678-49e6-8196-5213ef90e225 for instance with vm_state active and task_state deleting.
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-vif-unplugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] No waiting events found dispatching network-vif-unplugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-vif-unplugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Acquiring lock "e319b28e-a026-4491-b499-a656711f4c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] Lock "e319b28e-a026-4491-b499-a656711f4c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] No waiting events found dispatching network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:05:41 user nova-compute[72184]: WARNING nova.compute.manager [req-36127f10-f5e2-4156-8218-1bf5f28f32f2 req-6450a07c-e33a-4d7b-a1f7-779b89f994d4 service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received unexpected event network-vif-plugged-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 for instance with vm_state active and task_state deleting.
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] Instance destroyed successfully.
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lazy-loading 'resources' on Instance uuid e319b28e-a026-4491-b499-a656711f4c52 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:41 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Took 1.40 seconds to deallocate network for instance.
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-380742335',display_name='tempest-AttachVolumeNegativeTest-server-380742335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-380742335',id=28,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU6ecdTmg1BGTpYLeejXYLZ6riHTbK9JkE3ZnchwVn8WkWWAXfHnn5vJJdXgU6MSAHCYn63KfMUJAbrg2gItIGUt/D3qH6Qel4BR1DUO+ldC3owMp0Isbfkg2EkuhAs0w==',key_name='tempest-keypair-2125851177',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:02:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7490e7fdbe46cd8618b6431046108b',ramdisk_id='',reservation_id='r-88w6cic4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1778743204',owner_user_name='tempest-AttachVolumeNegativeTest-1778743204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154bf9bc1d904d55a86bd739a2f65677',uuid=e319b28e-a026-4491-b499-a656711f4c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converting VIF {"id": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "address": "fa:16:3e:2a:b8:aa", "network": {"id": "0fed17ea-2d46-4d42-952a-eef00b03fead", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-981804590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7490e7fdbe46cd8618b6431046108b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15c3c84-1c", "ovs_interfaceid": "b15c3c84-1c87-4a8b-a3c5-57b349e24d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG os_vif [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-81011e55-2cb5-4d07-98a9-c186d68fb466 req-c910c705-e477-4238-bf94-248919dbc0fa service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Received event network-vif-deleted-fc02a82f-c678-49e6-8196-5213ef90e225 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:41 user nova-compute[72184]: INFO nova.compute.manager [req-81011e55-2cb5-4d07-98a9-c186d68fb466 req-c910c705-e477-4238-bf94-248919dbc0fa service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Neutron deleted interface fc02a82f-c678-49e6-8196-5213ef90e225; detaching it from the instance and deleting it from the info cache
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-81011e55-2cb5-4d07-98a9-c186d68fb466 req-c910c705-e477-4238-bf94-248919dbc0fa service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb15c3c84-1c, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:05:41 user nova-compute[72184]: INFO os_vif [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b15c3c84-1c87-4a8b-a3c5-57b349e24d79,network=Network(0fed17ea-2d46-4d42-952a-eef00b03fead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15c3c84-1c')
Aug 01 17:05:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Deleting instance files /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52_del
Aug 01 17:05:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Deletion of /opt/stack/data/nova/instances/e319b28e-a026-4491-b499-a656711f4c52_del complete
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-81011e55-2cb5-4d07-98a9-c186d68fb466 req-c910c705-e477-4238-bf94-248919dbc0fa service nova] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Detach interface failed, port_id=fc02a82f-c678-49e6-8196-5213ef90e225, reason: Instance 1ba84814-1a19-453e-9482-3fae91ae857d could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:05:41 user nova-compute[72184]: INFO nova.compute.manager [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] [instance: e319b28e-a026-4491-b499-a656711f4c52] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 17:05:41 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:05:41 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:05:42 user nova-compute[72184]: INFO nova.compute.manager [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Took 0.75 seconds to detach 1 volumes for instance.
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:42 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] Took 0.80 seconds to deallocate network for instance.
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.214s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:42 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Deleted allocations for instance 1ba84814-1a19-453e-9482-3fae91ae857d
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-caee5230-7240-44c1-9cd6-f836b0965654 tempest-ServerActionsTestOtherB-1303337288 tempest-ServerActionsTestOtherB-1303337288-project-member] Lock "1ba84814-1a19-453e-9482-3fae91ae857d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.917s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:42 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Deleted allocations for instance e319b28e-a026-4491-b499-a656711f4c52
Aug 01 17:05:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10f0f3d2-9c3f-4e00-967e-e3639c231041 tempest-AttachVolumeNegativeTest-1778743204 tempest-AttachVolumeNegativeTest-1778743204-project-member] Lock "e319b28e-a026-4491-b499-a656711f4c52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-1c717eb1-6c8d-404a-9b64-873371956c11 req-00b70385-92ca-4ad2-ab89-4e0a522b1e8d service nova] [instance: e319b28e-a026-4491-b499-a656711f4c52] Received event network-vif-deleted-b15c3c84-1c87-4a8b-a3c5-57b349e24d79 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'flavor' on Instance uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:43 user nova-compute[72184]: INFO nova.compute.manager [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Attaching volume 8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 to /dev/vdb
Aug 01 17:05:44 user nova-compute[72184]: DEBUG os_brick.utils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[944147e5-8e7c-4c57-be54-d7651cc488b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa27de8-76da-4202-8abb-e0fc81a63d1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4044bb8d-796e-4989-9aba-b92af1d35eb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1db9a2-d95c-44e1-ba19-ccf212eb5f15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:05:44 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:05:44 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00098556-2041-4cc5-b2be-767303c2c0e1]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG os_brick.utils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating existing volume attachment record: 96284ef3-d6ad-42c1-9541-0b859f621961 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:05:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBPZqHAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:05:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:05:51 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae211306-1f3d-4fa1-a1c7-3daeaeea0de6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:05:51 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c3095a-8521-4338-829b-91b918a83550]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1] added
Aug 01 17:05:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef8f642-5a63-4158-841d-ac10cd77797b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8bd35-0f02-44c5-9264-00879ead3cd1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBPZqHAb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBPZqHAb" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe6b9a-232f-4072-81a3-e2d67f402f71]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBPZqHAb'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[18693b75-2aaf-41e5-9ed6-35472aa628ad]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc2e3d-2682-4937-8b5c-8afc19e7fc5e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8832569-801d-45f5-b2cc-7c16467bee18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260]
Aug 01 17:05:51 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260] successful.
Aug 01 17:05:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1287323-a068-4ef8-803c-9ad351f25aee]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[193a8fb5-ff82-4df0-a36c-fe7517df9b7b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:05:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:05:51 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:05:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc01807-a727-47b6-b4d2-f1c2561f1056]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:05:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909537.5158405, 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:52 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] VM Stopped (Lifecycle Event)
Aug 01 17:05:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2aa04e8e-e0cd-43ad-a5ce-cec442afb513 None None] [instance: 2f1c7277-ffc0-4b2b-be24-ca5a5ccefdf8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBPZqHAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26336383266386466', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336383266386466', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'flavor' on Instance uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:05:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:05:52 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:05:52 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:05:52 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:05:52 user nova-compute[72184]:   <serial>8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1</serial>
Aug 01 17:05:52 user nova-compute[72184]: </disk>
Aug 01 17:05:52 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:05:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:05:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:05:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] No VIF found with MAC fa:16:3e:5e:96:39, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:05:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a802fb07-c481-484b-8dca-509cfeba0081 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.536s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:53 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909539.4497137, 1ba84814-1a19-453e-9482-3fae91ae857d => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:54 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] VM Stopped (Lifecycle Event)
Aug 01 17:05:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-40b3f32e-0ad1-48b2-b041-012f9cc2235c None None] [instance: 1ba84814-1a19-453e-9482-3fae91ae857d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing instance network info cache due to event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909541.246094, e319b28e-a026-4491-b499-a656711f4c52 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:05:56 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: e319b28e-a026-4491-b499-a656711f4c52] VM Stopped (Lifecycle Event)
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5d20e3cf-048e-4df6-ab42-cc81d006438f None None] [instance: e319b28e-a026-4491-b499-a656711f4c52] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updated VIF entry in instance network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b3972b1-0713-43d4-a2b7-40874ec620a9 req-5c43ba83-dc70-443b-8844-f1741b416b2d service nova] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:05:57 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:05:57 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:05:57 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7427MB free_disk=25.039081573486328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing instance network info cache due to event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 52833ca5-abaa-44e7-90b1-3e18928101c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5caa7061-eba6-4c6c-b72b-f884a074f5c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:05:58 user nova-compute[72184]: INFO nova.compute.manager [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Rebooting instance
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updated VIF entry in instance network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.network.neutron [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a2caebc9-8a8f-48a6-9d50-5704961b374e req-443a6dd3-8cad-4dd7-9d88-58608b0eefe8 service nova] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:05:58 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:05:59 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:06:00 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:00 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:06:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-2a009ae7-fc6b-4a85-9b8a-0853d8f4e9b3 req-0e52e658-1c57-4a7f-9f23-286d7b77315e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-unplugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2a009ae7-fc6b-4a85-9b8a-0853d8f4e9b3 req-0e52e658-1c57-4a7f-9f23-286d7b77315e service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2a009ae7-fc6b-4a85-9b8a-0853d8f4e9b3 req-0e52e658-1c57-4a7f-9f23-286d7b77315e service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2a009ae7-fc6b-4a85-9b8a-0853d8f4e9b3 req-0e52e658-1c57-4a7f-9f23-286d7b77315e service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-2a009ae7-fc6b-4a85-9b8a-0853d8f4e9b3 req-0e52e658-1c57-4a7f-9f23-286d7b77315e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-unplugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:01 user nova-compute[72184]: WARNING nova.compute.manager [req-2a009ae7-fc6b-4a85-9b8a-0853d8f4e9b3 req-0e52e658-1c57-4a7f-9f23-286d7b77315e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-unplugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state active and task_state reboot_started.
Aug 01 17:06:01 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance shutdown successfully.
Aug 01 17:06:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-0dc1baf5-2acf-421f-abf5-e0c11fc1a40d req-d1dcf84d-ace2-4c74-a79c-65e60fc10492 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0dc1baf5-2acf-421f-abf5-e0c11fc1a40d req-d1dcf84d-ace2-4c74-a79c-65e60fc10492 service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0dc1baf5-2acf-421f-abf5-e0c11fc1a40d req-d1dcf84d-ace2-4c74-a79c-65e60fc10492 service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0dc1baf5-2acf-421f-abf5-e0c11fc1a40d req-d1dcf84d-ace2-4c74-a79c-65e60fc10492 service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-0dc1baf5-2acf-421f-abf5-e0c11fc1a40d req-d1dcf84d-ace2-4c74-a79c-65e60fc10492 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:03 user nova-compute[72184]: WARNING nova.compute.manager [req-0dc1baf5-2acf-421f-abf5-e0c11fc1a40d req-d1dcf84d-ace2-4c74-a79c-65e60fc10492 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state active and task_state reboot_started.
Aug 01 17:06:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:05 user nova-compute[72184]: WARNING nova.compute.manager [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state active and task_state reboot_started.
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:05 user nova-compute[72184]: WARNING nova.compute.manager [req-31740a18-cb5d-402e-a202-6d5739daacb5 req-0bf43b20-d537-42b0-88e7-4e7eb5ba895e service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state active and task_state reboot_started.
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 612209a3-7d0f-44a3-b237-9bdccaab6d8a due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909565.7677715, 612209a3-7d0f-44a3-b237-9bdccaab6d8a => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:05 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] VM Resumed (Lifecycle Event)
Aug 01 17:06:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance running successfully.
Aug 01 17:06:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance soft rebooted successfully.
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:06:05 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909565.7691357, 612209a3-7d0f-44a3-b237-9bdccaab6d8a => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:05 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] VM Started (Lifecycle Event)
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:06:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b9fdfd47-7998-419f-858b-325865cb0128 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.430s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing instance network info cache due to event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updated VIF entry in instance network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-827754a9-efcd-46f3-952d-312210c3af37 req-7940d3cf-92a6-45b6-b577-231fe37f6dac service nova] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:18 user nova-compute[72184]: INFO nova.compute.manager [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Detaching volume ecca2701-652e-4e52-8429-66a371c105f6
Aug 01 17:06:18 user nova-compute[72184]: INFO nova.virt.block_device [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Attempting to driver detach volume ecca2701-652e-4e52-8429-66a371c105f6 from mountpoint /dev/vdb
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Attempting to detach device vdb from instance 90809a35-7659-492d-a605-e3b40e161bbf from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:06:18 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:06:18 user nova-compute[72184]:   <source dev="/dev/sdh"/>
Aug 01 17:06:18 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:06:18 user nova-compute[72184]:   <serial>ecca2701-652e-4e52-8429-66a371c105f6</serial>
Aug 01 17:06:18 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:06:18 user nova-compute[72184]: </disk>
Aug 01 17:06:18 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:06:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully detached device vdb from instance 90809a35-7659-492d-a605-e3b40e161bbf from the persistent domain config.
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90809a35-7659-492d-a605-e3b40e161bbf from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:06:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:06:18 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:06:18 user nova-compute[72184]:   <source dev="/dev/sdh"/>
Aug 01 17:06:18 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:06:18 user nova-compute[72184]:   <serial>ecca2701-652e-4e52-8429-66a371c105f6</serial>
Aug 01 17:06:18 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:06:18 user nova-compute[72184]: </disk>
Aug 01 17:06:18 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909579.211642, 90809a35-7659-492d-a605-e3b40e161bbf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:06:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully detached device vdb from instance 90809a35-7659-492d-a605-e3b40e161bbf from the live domain config.
Aug 01 17:06:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJCEgzuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:06:19 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838dbff-a73e-40ec-a4e3-b063c98cfa29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87625229-0e3d-418a-afaa-609fcf38f9e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:06:19 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:06:19 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:06:19 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:06:19 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:06:19 user nova-compute[72184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 (non-flash)
Aug 01 17:06:19 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:06:19 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:06:19 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff85e2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6'): ({'sdh'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Removing single pathed devices sdh {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0a8d8-4b34-455e-9e5c-b6a53cac8b85]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c1441-a4ab-4406-9e17-7cbf1869ac1d]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Flushing IO for device /dev/sdh {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c993654-f091-4fb3-92b6-334add1758c4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d892cc2a-98b8-4543-9884-2df1e9de3438]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] SCSI volumes sdh have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9426d7-bbd5-46e0-9532-c6f338122957]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4361bbb1-d21c-443e-b7ad-e60c4d79a064]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260]
Aug 01 17:06:19 user nova-compute[72184]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6, portal: 172.16.0.220,3260] successful.
Aug 01 17:06:19 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecca2701-652e-4e52-8429-66a371c105f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e847b71-bf35-4622-8cc5-8d62db584188]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] <== disconnect_volume: return (280ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:06:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing instance network info cache due to event network-changed-e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] Acquiring lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] Acquired lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Refreshing network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'flavor' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a64943cb-cfb4-44bd-8b28-e2f77f688a37 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updated VIF entry in instance network info cache for port e026812f-e506-4c8f-b5ac-58f30b5c82b4. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [{"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a097bab2-0fa7-4637-aea5-368681e27a99 req-950c8d1f-f6b4-4b4c-a7ad-5d4f56610591 service nova] Releasing lock "refresh_cache-90809a35-7659-492d-a605-e3b40e161bbf" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:06:26 user nova-compute[72184]: INFO nova.compute.claims [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Claim successful on node user
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:06:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:06:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:06:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:06:27 user nova-compute[72184]: INFO nova.virt.block_device [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Booting with volume 539640be-b67b-4c4c-828f-1549014677be at /dev/vda
Aug 01 17:06:27 user nova-compute[72184]: DEBUG nova.policy [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09d472678ed94cb7ab09de7d72128f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef0982d76ca40a48b457e0797d6837b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG os_brick.utils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[108bdcbf-775d-4f7f-ad95-d6d0800f18a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d56e6-d47f-44f0-b5b7-14f3a47e64d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7275ee40-b128-425d-bd5e-f26d5e7f431d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24d3e37-aebd-4e47-a70a-9d1fcfd8415c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:06:27 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:06:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7daab9-1e01-47e9-ba01-d86a468a1290]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG os_brick.utils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating existing volume attachment record: 80395f68-f04f-4ffd-b58f-5fd19197f4b8 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:06:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Successfully created port: 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Successfully updated port: 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.compute.manager [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-changed-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.compute.manager [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Refreshing instance network info cache due to event network-changed-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance network_info: |[{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:06:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Refreshing network info cache for port 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:06:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updated VIF entry in instance network info cache for port 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:06:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-223c1e0a-c447-4b03-a2cd-b501dbef9b36 req-adb6b2fb-1ba2-438b-a925-3695d2300719 service nova] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:06:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Creating image(s)
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa80855-fc9c-4fc3-9afc-42fff581a74e/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Start _get_guest_xml network_info=[{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '80395f68-f04f-4ffd-b58f-5fd19197f4b8', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0aa80855-fc9c-4fc3-9afc-42fff581a74e', 'attached_at': '', 'detached_at': '', 'volume_id': '539640be-b67b-4c4c-828f-1549014677be', 'serial': '539640be-b67b-4c4c-828f-1549014677be'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:06:35 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:06:35 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:06:35 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:06:35 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:06:35 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492b717-1ea3-4f67-a362-cc33b8378bb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:06:35 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[812461d9-600f-4c9e-90cb-0433b467457e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be] added
Aug 01 17:06:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d7c47-51ba-47aa-a379-a608516e6b10]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80a95f-e457-4382-9278-3d613dfb24d2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkiUftyG {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkiUftyG" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523d060-e289-4472-b609-c6d655d73cb0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkiUftyG'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c5099-2a7d-47df-86aa-68a36cf28407]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f3a7dc-9459-42ea-80a5-83da3951b381]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:06:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:06:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b118b30-fe51-4829-be89-e760d7c6ffeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]
Aug 01 17:06:35 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.
Aug 01 17:06:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[537b1b23-f057-4e1e-b789-48e702ce2801]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf12c3a-65a2-4fa8-af95-bf608869c7d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:06:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:06:35 user nova-compute[72184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:06:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f1e907-01fc-41a0-bbf8-ef3cf3b0278a]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:06:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26166636562366339', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166636562366339', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1155008516',display_name='tempest-ServerActionsTestOtherA-server-1155008516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1155008516',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-d072894v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=0aa80855-fc9c-4fc3-9afc-42fff581a74e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:06:36 user nova-compute[72184]:   <uuid>0aa80855-fc9c-4fc3-9afc-42fff581a74e</uuid>
Aug 01 17:06:36 user nova-compute[72184]:   <name>instance-00000021</name>
Aug 01 17:06:36 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:06:36 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:06:36 user nova-compute[72184]:   <metadata>
Aug 01 17:06:36 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:06:36 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:06:36 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherA-server-1155008516</nova:name>
Aug 01 17:06:36 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:06:35</nova:creationTime>
Aug 01 17:06:36 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:06:36 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:06:36 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:06:36 user nova-compute[72184]:       <nova:owner>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:user uuid="09d472678ed94cb7ab09de7d72128f84">tempest-ServerActionsTestOtherA-2143698002-project-member</nova:user>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:project uuid="3ef0982d76ca40a48b457e0797d6837b">tempest-ServerActionsTestOtherA-2143698002</nova:project>
Aug 01 17:06:36 user nova-compute[72184]:       </nova:owner>
Aug 01 17:06:36 user nova-compute[72184]:       <nova:ports>
Aug 01 17:06:36 user nova-compute[72184]:         <nova:port uuid="1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f">
Aug 01 17:06:36 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 17:06:36 user nova-compute[72184]:         </nova:port>
Aug 01 17:06:36 user nova-compute[72184]:       </nova:ports>
Aug 01 17:06:36 user nova-compute[72184]:     </nova:instance>
Aug 01 17:06:36 user nova-compute[72184]:   </metadata>
Aug 01 17:06:36 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:06:36 user nova-compute[72184]:     <system>
Aug 01 17:06:36 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:06:36 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:06:36 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:06:36 user nova-compute[72184]:       <entry name="serial">0aa80855-fc9c-4fc3-9afc-42fff581a74e</entry>
Aug 01 17:06:36 user nova-compute[72184]:       <entry name="uuid">0aa80855-fc9c-4fc3-9afc-42fff581a74e</entry>
Aug 01 17:06:36 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:06:36 user nova-compute[72184]:     </system>
Aug 01 17:06:36 user nova-compute[72184]:   </sysinfo>
Aug 01 17:06:36 user nova-compute[72184]:   <os>
Aug 01 17:06:36 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:06:36 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:06:36 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:06:36 user nova-compute[72184]:   </os>
Aug 01 17:06:36 user nova-compute[72184]:   <features>
Aug 01 17:06:36 user nova-compute[72184]:     <acpi/>
Aug 01 17:06:36 user nova-compute[72184]:     <apic/>
Aug 01 17:06:36 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:06:36 user nova-compute[72184]:   </features>
Aug 01 17:06:36 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:06:36 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:06:36 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:06:36 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:06:36 user nova-compute[72184]:   </clock>
Aug 01 17:06:36 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:06:36 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:06:36 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:06:36 user nova-compute[72184]:   </cpu>
Aug 01 17:06:36 user nova-compute[72184]:   <devices>
Aug 01 17:06:36 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:06:36 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:06:36 user nova-compute[72184]:       <source dev="/dev/sdd"/>
Aug 01 17:06:36 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:06:36 user nova-compute[72184]:       <serial>539640be-b67b-4c4c-828f-1549014677be</serial>
Aug 01 17:06:36 user nova-compute[72184]:     </disk>
Aug 01 17:06:36 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:06:36 user nova-compute[72184]:       <mac address="fa:16:3e:df:ac:1c"/>
Aug 01 17:06:36 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:06:36 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:06:36 user nova-compute[72184]:       <target dev="tap1a68d1d0-09"/>
Aug 01 17:06:36 user nova-compute[72184]:     </interface>
Aug 01 17:06:36 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:06:36 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/0aa80855-fc9c-4fc3-9afc-42fff581a74e/console.log" append="off"/>
Aug 01 17:06:36 user nova-compute[72184]:     </serial>
Aug 01 17:06:36 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:06:36 user nova-compute[72184]:     <video>
Aug 01 17:06:36 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:06:36 user nova-compute[72184]:     </video>
Aug 01 17:06:36 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:06:36 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:06:36 user nova-compute[72184]:     </rng>
Aug 01 17:06:36 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:06:36 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:06:36 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:06:36 user nova-compute[72184]:     </memballoon>
Aug 01 17:06:36 user nova-compute[72184]:   </devices>
Aug 01 17:06:36 user nova-compute[72184]: </domain>
Aug 01 17:06:36 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1155008516',display_name='tempest-ServerActionsTestOtherA-server-1155008516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1155008516',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-d072894v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=0aa80855-fc9c-4fc3-9afc-42fff581a74e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG os_vif [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a68d1d0-09, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a68d1d0-09, col_values=(('external_ids', {'iface-id': '1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ac:1c', 'vm-uuid': '0aa80855-fc9c-4fc3-9afc-42fff581a74e'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:36 user nova-compute[72184]: INFO os_vif [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09')
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:06:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No VIF found with MAC fa:16:3e:df:ac:1c, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-4a7a5cb5-b83e-4e12-b6a7-eca53692f8c8 req-b58b3b82-b840-49fa-8d73-3cc480649bbf service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4a7a5cb5-b83e-4e12-b6a7-eca53692f8c8 req-b58b3b82-b840-49fa-8d73-3cc480649bbf service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4a7a5cb5-b83e-4e12-b6a7-eca53692f8c8 req-b58b3b82-b840-49fa-8d73-3cc480649bbf service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4a7a5cb5-b83e-4e12-b6a7-eca53692f8c8 req-b58b3b82-b840-49fa-8d73-3cc480649bbf service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-4a7a5cb5-b83e-4e12-b6a7-eca53692f8c8 req-b58b3b82-b840-49fa-8d73-3cc480649bbf service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:38 user nova-compute[72184]: WARNING nova.compute.manager [req-4a7a5cb5-b83e-4e12-b6a7-eca53692f8c8 req-b58b3b82-b840-49fa-8d73-3cc480649bbf service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state building and task_state spawning.
Aug 01 17:06:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909600.3980293, 0aa80855-fc9c-4fc3-9afc-42fff581a74e => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] VM Resumed (Lifecycle Event)
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance spawned successfully.
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-4101f96c-626b-4244-a0b7-e20373563e91 req-31f6cb07-0827-4e2e-ad06-aaed717ef1cc service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4101f96c-626b-4244-a0b7-e20373563e91 req-31f6cb07-0827-4e2e-ad06-aaed717ef1cc service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4101f96c-626b-4244-a0b7-e20373563e91 req-31f6cb07-0827-4e2e-ad06-aaed717ef1cc service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4101f96c-626b-4244-a0b7-e20373563e91 req-31f6cb07-0827-4e2e-ad06-aaed717ef1cc service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-4101f96c-626b-4244-a0b7-e20373563e91 req-31f6cb07-0827-4e2e-ad06-aaed717ef1cc service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:40 user nova-compute[72184]: WARNING nova.compute.manager [req-4101f96c-626b-4244-a0b7-e20373563e91 req-31f6cb07-0827-4e2e-ad06-aaed717ef1cc service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state building and task_state spawning.
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909600.4024577, 0aa80855-fc9c-4fc3-9afc-42fff581a74e => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] VM Started (Lifecycle Event)
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 01 17:06:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:40 user nova-compute[72184]: INFO nova.compute.manager [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Took 14.21 seconds to build instance.
Aug 01 17:06:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-efc5fdb5-e2f1-4958-b461-d46ef6851f0e tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.307s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:43 user nova-compute[72184]: INFO nova.compute.manager [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Terminating instance
Aug 01 17:06:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-552f1646-ed44-49f7-b951-c1f0debe1442 req-9c6e8fdc-b876-4c00-ab0e-cfc77ab197b0 service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-vif-unplugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-552f1646-ed44-49f7-b951-c1f0debe1442 req-9c6e8fdc-b876-4c00-ab0e-cfc77ab197b0 service nova] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-552f1646-ed44-49f7-b951-c1f0debe1442 req-9c6e8fdc-b876-4c00-ab0e-cfc77ab197b0 service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-552f1646-ed44-49f7-b951-c1f0debe1442 req-9c6e8fdc-b876-4c00-ab0e-cfc77ab197b0 service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-552f1646-ed44-49f7-b951-c1f0debe1442 req-9c6e8fdc-b876-4c00-ab0e-cfc77ab197b0 service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] No waiting events found dispatching network-vif-unplugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-552f1646-ed44-49f7-b951-c1f0debe1442 req-9c6e8fdc-b876-4c00-ab0e-cfc77ab197b0 service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-vif-unplugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:06:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Instance destroyed successfully.
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lazy-loading 'resources' on Instance uuid 5caa7061-eba6-4c6c-b72b-f884a074f5c8 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-545995869',display_name='tempest-VolumesActionsTest-instance-545995869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-545995869',id=32,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:05:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff6a0fda580e4e6a9ea4e26d30df9e67',ramdisk_id='',reservation_id='r-57iwdv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-197584980',owner_user_name='tempest-VolumesActionsTest-197584980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:05:02Z,user_data=None,user_id='8fe75ee370f04c89af06c3eb592c585a',uuid=5caa7061-eba6-4c6c-b72b-f884a074f5c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converting VIF {"id": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "address": "fa:16:3e:78:0a:c5", "network": {"id": "521f0ab4-2632-4f4d-86c3-c6d43eac2cbe", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1220062535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff6a0fda580e4e6a9ea4e26d30df9e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253454f2-7b", "ovs_interfaceid": "253454f2-7b78-4a40-bef3-e9716c28a4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG os_vif [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap253454f2-7b, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:44 user nova-compute[72184]: INFO os_vif [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:c5,bridge_name='br-int',has_traffic_filtering=True,id=253454f2-7b78-4a40-bef3-e9716c28a4c3,network=Network(521f0ab4-2632-4f4d-86c3-c6d43eac2cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253454f2-7b')
Aug 01 17:06:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Deleting instance files /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8_del
Aug 01 17:06:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Deletion of /opt/stack/data/nova/instances/5caa7061-eba6-4c6c-b72b-f884a074f5c8_del complete
Aug 01 17:06:44 user nova-compute[72184]: INFO nova.compute.manager [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 01 17:06:44 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:06:44 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:06:45 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:45 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Took 0.57 seconds to deallocate network for instance.
Aug 01 17:06:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:45 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:06:45 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:06:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:45 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Deleted allocations for instance 5caa7061-eba6-4c6c-b72b-f884a074f5c8
Aug 01 17:06:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-335ec10a-e00f-4c9d-bde2-853c0b4b427d tempest-VolumesActionsTest-197584980 tempest-VolumesActionsTest-197584980-project-member] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] Acquiring lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] Lock "5caa7061-eba6-4c6c-b72b-f884a074f5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] No waiting events found dispatching network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:46 user nova-compute[72184]: WARNING nova.compute.manager [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received unexpected event network-vif-plugged-253454f2-7b78-4a40-bef3-e9716c28a4c3 for instance with vm_state deleted and task_state None.
Aug 01 17:06:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-9a552055-6981-4094-8e29-c9c00aaa3983 req-155f2c0f-ed2f-48d1-ba58-d1344423a7ad service nova] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Received event network-vif-deleted-253454f2-7b78-4a40-bef3-e9716c28a4c3 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:06:48 user nova-compute[72184]: INFO nova.compute.claims [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Claim successful on node user
Aug 01 17:06:48 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:06:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.policy [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0c8a60b3824038802bc7bb2298988f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb72853e93848b6995582327cd53b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:06:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Creating image(s)
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "/opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "/opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk 1073741824" returned: 0 in 0.064s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Successfully created port: 2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Cannot resize image /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'migration_context' on Instance uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Ensure instance console log exists: /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Successfully updated port: 2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquired lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-changed-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Refreshing instance network info cache due to event network-changed-2d43cfa7-0928-4571-8e6c-1fd4108cb358. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] Acquiring lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:06:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updating instance_info_cache with network_info: [{"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Releasing lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Instance network_info: |[{"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] Acquired lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Refreshing network info cache for port 2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Start _get_guest_xml network_info=[{"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:06:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:06:51 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-908352431',display_name='tempest-VolumesSnapshotTestJSON-instance-908352431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-908352431',id=34,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJdBAb2DGdyDFgOP9YYe1EPkZSECFRqmnRaUfccbz2+AdBUtsQPWUv+eP/CvO5tH0F1K5xvS5ly7EhEWqcYCdvI8+d6LmWODMIZeW4fhkNYK6NiN3YH+hQ45zPJfbnesw==',key_name='tempest-keypair-1580667645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb72853e93848b6995582327cd53b9a',ramdisk_id='',reservation_id='r-rdv0mblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-785628539',owner_user_name='tempest-VolumesSnapshotTestJSON-785628539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0c8a60b3824038802bc7bb2298988f',uuid=8e5746d0-f2bb-4523-9517-7c8817fd2811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converting VIF {"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:06:51 user nova-compute[72184]:   <uuid>8e5746d0-f2bb-4523-9517-7c8817fd2811</uuid>
Aug 01 17:06:51 user nova-compute[72184]:   <name>instance-00000022</name>
Aug 01 17:06:51 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:06:51 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:06:51 user nova-compute[72184]:   <metadata>
Aug 01 17:06:51 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:06:51 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:06:51 user nova-compute[72184]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-908352431</nova:name>
Aug 01 17:06:51 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:06:51</nova:creationTime>
Aug 01 17:06:51 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:06:51 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:06:51 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:06:51 user nova-compute[72184]:       <nova:owner>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:user uuid="8f0c8a60b3824038802bc7bb2298988f">tempest-VolumesSnapshotTestJSON-785628539-project-member</nova:user>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:project uuid="0bb72853e93848b6995582327cd53b9a">tempest-VolumesSnapshotTestJSON-785628539</nova:project>
Aug 01 17:06:51 user nova-compute[72184]:       </nova:owner>
Aug 01 17:06:51 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:06:51 user nova-compute[72184]:       <nova:ports>
Aug 01 17:06:51 user nova-compute[72184]:         <nova:port uuid="2d43cfa7-0928-4571-8e6c-1fd4108cb358">
Aug 01 17:06:51 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 17:06:51 user nova-compute[72184]:         </nova:port>
Aug 01 17:06:51 user nova-compute[72184]:       </nova:ports>
Aug 01 17:06:51 user nova-compute[72184]:     </nova:instance>
Aug 01 17:06:51 user nova-compute[72184]:   </metadata>
Aug 01 17:06:51 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:06:51 user nova-compute[72184]:     <system>
Aug 01 17:06:51 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:06:51 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:06:51 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:06:51 user nova-compute[72184]:       <entry name="serial">8e5746d0-f2bb-4523-9517-7c8817fd2811</entry>
Aug 01 17:06:51 user nova-compute[72184]:       <entry name="uuid">8e5746d0-f2bb-4523-9517-7c8817fd2811</entry>
Aug 01 17:06:51 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:06:51 user nova-compute[72184]:     </system>
Aug 01 17:06:51 user nova-compute[72184]:   </sysinfo>
Aug 01 17:06:51 user nova-compute[72184]:   <os>
Aug 01 17:06:51 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:06:51 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:06:51 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:06:51 user nova-compute[72184]:   </os>
Aug 01 17:06:51 user nova-compute[72184]:   <features>
Aug 01 17:06:51 user nova-compute[72184]:     <acpi/>
Aug 01 17:06:51 user nova-compute[72184]:     <apic/>
Aug 01 17:06:51 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:06:51 user nova-compute[72184]:   </features>
Aug 01 17:06:51 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:06:51 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:06:51 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:06:51 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:06:51 user nova-compute[72184]:   </clock>
Aug 01 17:06:51 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:06:51 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:06:51 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:06:51 user nova-compute[72184]:   </cpu>
Aug 01 17:06:51 user nova-compute[72184]:   <devices>
Aug 01 17:06:51 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:06:51 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:06:51 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk"/>
Aug 01 17:06:51 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:06:51 user nova-compute[72184]:     </disk>
Aug 01 17:06:51 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:06:51 user nova-compute[72184]:       <mac address="fa:16:3e:f2:32:c5"/>
Aug 01 17:06:51 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:06:51 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:06:51 user nova-compute[72184]:       <target dev="tap2d43cfa7-09"/>
Aug 01 17:06:51 user nova-compute[72184]:     </interface>
Aug 01 17:06:51 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:06:51 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/console.log" append="off"/>
Aug 01 17:06:51 user nova-compute[72184]:     </serial>
Aug 01 17:06:51 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:06:51 user nova-compute[72184]:     <video>
Aug 01 17:06:51 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:06:51 user nova-compute[72184]:     </video>
Aug 01 17:06:51 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:06:51 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:06:51 user nova-compute[72184]:     </rng>
Aug 01 17:06:51 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:06:51 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:06:51 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:06:51 user nova-compute[72184]:     </memballoon>
Aug 01 17:06:51 user nova-compute[72184]:   </devices>
Aug 01 17:06:51 user nova-compute[72184]: </domain>
Aug 01 17:06:51 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-908352431',display_name='tempest-VolumesSnapshotTestJSON-instance-908352431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-908352431',id=34,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJdBAb2DGdyDFgOP9YYe1EPkZSECFRqmnRaUfccbz2+AdBUtsQPWUv+eP/CvO5tH0F1K5xvS5ly7EhEWqcYCdvI8+d6LmWODMIZeW4fhkNYK6NiN3YH+hQ45zPJfbnesw==',key_name='tempest-keypair-1580667645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb72853e93848b6995582327cd53b9a',ramdisk_id='',reservation_id='r-rdv0mblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-785628539',owner_user_name='tempest-VolumesSnapshotTestJSON-785628539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0c8a60b3824038802bc7bb2298988f',uuid=8e5746d0-f2bb-4523-9517-7c8817fd2811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converting VIF {"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG os_vif [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d43cfa7-09, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d43cfa7-09, col_values=(('external_ids', {'iface-id': '2d43cfa7-0928-4571-8e6c-1fd4108cb358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:32:c5', 'vm-uuid': '8e5746d0-f2bb-4523-9517-7c8817fd2811'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:51 user nova-compute[72184]: INFO os_vif [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09')
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No VIF found with MAC fa:16:3e:f2:32:c5, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updated VIF entry in instance network info cache for port 2d43cfa7-0928-4571-8e6c-1fd4108cb358. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updating instance_info_cache with network_info: [{"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:06:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3b501c09-972c-4c42-ba36-022c8f4f8502 req-87e2cc4b-41b7-4b07-b1c2-f4b8da915153 service nova] Releasing lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:06:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-56e67cde-0b1e-4d23-8f02-632f6f19ecdb req-3f32ff2f-4f34-499d-aa34-70602e72c99b service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-56e67cde-0b1e-4d23-8f02-632f6f19ecdb req-3f32ff2f-4f34-499d-aa34-70602e72c99b service nova] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-56e67cde-0b1e-4d23-8f02-632f6f19ecdb req-3f32ff2f-4f34-499d-aa34-70602e72c99b service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-56e67cde-0b1e-4d23-8f02-632f6f19ecdb req-3f32ff2f-4f34-499d-aa34-70602e72c99b service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-56e67cde-0b1e-4d23-8f02-632f6f19ecdb req-3f32ff2f-4f34-499d-aa34-70602e72c99b service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] No waiting events found dispatching network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:53 user nova-compute[72184]: WARNING nova.compute.manager [req-56e67cde-0b1e-4d23-8f02-632f6f19ecdb req-3f32ff2f-4f34-499d-aa34-70602e72c99b service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received unexpected event network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 for instance with vm_state building and task_state spawning.
Aug 01 17:06:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-dd536210-c307-467a-9710-ce042336677f req-120f6911-6df5-4094-a338-ffb3b558fee7 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dd536210-c307-467a-9710-ce042336677f req-120f6911-6df5-4094-a338-ffb3b558fee7 service nova] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dd536210-c307-467a-9710-ce042336677f req-120f6911-6df5-4094-a338-ffb3b558fee7 service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dd536210-c307-467a-9710-ce042336677f req-120f6911-6df5-4094-a338-ffb3b558fee7 service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-dd536210-c307-467a-9710-ce042336677f req-120f6911-6df5-4094-a338-ffb3b558fee7 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] No waiting events found dispatching network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:06:55 user nova-compute[72184]: WARNING nova.compute.manager [req-dd536210-c307-467a-9710-ce042336677f req-120f6911-6df5-4094-a338-ffb3b558fee7 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received unexpected event network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 for instance with vm_state building and task_state spawning.
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909615.070002, 8e5746d0-f2bb-4523-9517-7c8817fd2811 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] VM Resumed (Lifecycle Event)
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Instance spawned successfully.
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909615.0715597, 8e5746d0-f2bb-4523-9517-7c8817fd2811 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] VM Started (Lifecycle Event)
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 01 17:06:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:55 user nova-compute[72184]: INFO nova.compute.manager [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Took 6.84 seconds to build instance.
Aug 01 17:06:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f71148d3-f11c-4bd8-b94c-20ee13e3d5d6 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.949s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:55 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:06:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909604.3375583, 5caa7061-eba6-4c6c-b72b-f884a074f5c8 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:06:59 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] VM Stopped (Lifecycle Event)
Aug 01 17:06:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-012abcee-c07c-4ee6-8854-3bc7e6ec82b9 None None] [instance: 5caa7061-eba6-4c6c-b72b-f884a074f5c8] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:06:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:00 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:07:00 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7375MB free_disk=25.052371978759766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 90809a35-7659-492d-a605-e3b40e161bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 52833ca5-abaa-44e7-90b1-3e18928101c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:07:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:07:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:09 user nova-compute[72184]: INFO nova.compute.manager [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Terminating instance
Aug 01 17:07:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Instance destroyed successfully.
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'resources' on Instance uuid 90809a35-7659-492d-a605-e3b40e161bbf {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-461366033',display_name='tempest-ServerRescueNegativeTestJSON-server-461366033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-461366033',id=24,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP+bS68qWQCoGZnJjxF1jc58ptndhJiEmnwylfKG9P48v8l3rYgjYPJ1jEFvOMPHwVFjb5aOT+5fNYfzwD56nXkiweV3qOUb8Xwz5GX5QsXqzSaIJRLyGtlCqA+ledbvA==',key_name='tempest-keypair-1369140919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-uyzjywnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=90809a35-7659-492d-a605-e3b40e161bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "address": "fa:16:3e:91:d0:8d", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape026812f-e5", "ovs_interfaceid": "e026812f-e506-4c8f-b5ac-58f30b5c82b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG os_vif [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-af22bbcf-e790-4621-8fa2-4658e53a7754 req-2cdbfae5-1eb6-47bc-8095-738685ade914 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af22bbcf-e790-4621-8fa2-4658e53a7754 req-2cdbfae5-1eb6-47bc-8095-738685ade914 service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af22bbcf-e790-4621-8fa2-4658e53a7754 req-2cdbfae5-1eb6-47bc-8095-738685ade914 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af22bbcf-e790-4621-8fa2-4658e53a7754 req-2cdbfae5-1eb6-47bc-8095-738685ade914 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-af22bbcf-e790-4621-8fa2-4658e53a7754 req-2cdbfae5-1eb6-47bc-8095-738685ade914 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-af22bbcf-e790-4621-8fa2-4658e53a7754 req-2cdbfae5-1eb6-47bc-8095-738685ade914 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-unplugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape026812f-e5, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:07:10 user nova-compute[72184]: INFO os_vif [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:d0:8d,bridge_name='br-int',has_traffic_filtering=True,id=e026812f-e506-4c8f-b5ac-58f30b5c82b4,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape026812f-e5')
Aug 01 17:07:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Deleting instance files /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf_del
Aug 01 17:07:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Deletion of /opt/stack/data/nova/instances/90809a35-7659-492d-a605-e3b40e161bbf_del complete
Aug 01 17:07:10 user nova-compute[72184]: INFO nova.compute.manager [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 01 17:07:10 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:07:10 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:07:11 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:07:11 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Took 1.06 seconds to deallocate network for instance.
Aug 01 17:07:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-663575f5-b88d-4db8-8181-394dfadc7fce req-080eec6b-f414-436a-8e19-eac34b89866c service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-deleted-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:11 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:07:11 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:07:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:12 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Deleted allocations for instance 90809a35-7659-492d-a605-e3b40e161bbf
Aug 01 17:07:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d12f1acf-8bf5-4f3c-8967-fa91fe7c1231 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "90809a35-7659-492d-a605-e3b40e161bbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.923s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-a6122098-7442-4b51-b615-df64f9988fde req-76cc5a8a-0167-4deb-a5c1-b8acf0ad7a08 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a6122098-7442-4b51-b615-df64f9988fde req-76cc5a8a-0167-4deb-a5c1-b8acf0ad7a08 service nova] Acquiring lock "90809a35-7659-492d-a605-e3b40e161bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a6122098-7442-4b51-b615-df64f9988fde req-76cc5a8a-0167-4deb-a5c1-b8acf0ad7a08 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a6122098-7442-4b51-b615-df64f9988fde req-76cc5a8a-0167-4deb-a5c1-b8acf0ad7a08 service nova] Lock "90809a35-7659-492d-a605-e3b40e161bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-a6122098-7442-4b51-b615-df64f9988fde req-76cc5a8a-0167-4deb-a5c1-b8acf0ad7a08 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] No waiting events found dispatching network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:07:12 user nova-compute[72184]: WARNING nova.compute.manager [req-a6122098-7442-4b51-b615-df64f9988fde req-76cc5a8a-0167-4deb-a5c1-b8acf0ad7a08 service nova] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Received unexpected event network-vif-plugged-e026812f-e506-4c8f-b5ac-58f30b5c82b4 for instance with vm_state deleted and task_state None.
Aug 01 17:07:12 user nova-compute[72184]: INFO nova.compute.manager [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Unrescuing
Aug 01 17:07:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquired lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:07:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updating instance_info_cache with network_info: [{"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Releasing lock "refresh_cache-52833ca5-abaa-44e7-90b1-3e18928101c2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'flavor' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-71b8237f-9937-4085-8ca5-bf10cf00e16c req-9f616420-60bb-4cd6-aab8-26e13028a193 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-71b8237f-9937-4085-8ca5-bf10cf00e16c req-9f616420-60bb-4cd6-aab8-26e13028a193 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-71b8237f-9937-4085-8ca5-bf10cf00e16c req-9f616420-60bb-4cd6-aab8-26e13028a193 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-71b8237f-9937-4085-8ca5-bf10cf00e16c req-9f616420-60bb-4cd6-aab8-26e13028a193 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-71b8237f-9937-4085-8ca5-bf10cf00e16c req-9f616420-60bb-4cd6-aab8-26e13028a193 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:07:13 user nova-compute[72184]: WARNING nova.compute.manager [req-71b8237f-9937-4085-8ca5-bf10cf00e16c req-9f616420-60bb-4cd6-aab8-26e13028a193 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:07:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance destroyed successfully.
Aug 01 17:07:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-23a17e5c-3208-4729-bdb9-eedc1525b676 req-14fe2134-1c10-42ad-b9e8-dab85f8c547d service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-23a17e5c-3208-4729-bdb9-eedc1525b676 req-14fe2134-1c10-42ad-b9e8-dab85f8c547d service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-23a17e5c-3208-4729-bdb9-eedc1525b676 req-14fe2134-1c10-42ad-b9e8-dab85f8c547d service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-23a17e5c-3208-4729-bdb9-eedc1525b676 req-14fe2134-1c10-42ad-b9e8-dab85f8c547d service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-23a17e5c-3208-4729-bdb9-eedc1525b676 req-14fe2134-1c10-42ad-b9e8-dab85f8c547d service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:07:15 user nova-compute[72184]: WARNING nova.compute.manager [req-23a17e5c-3208-4729-bdb9-eedc1525b676 req-14fe2134-1c10-42ad-b9e8-dab85f8c547d service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:07:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Removed pending event for 52833ca5-abaa-44e7-90b1-3e18928101c2 due to event {{(pid=72184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909637.734751, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:07:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Resumed (Lifecycle Event)
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0aa91f98-93c9-4e38-bf24-99e14fc429f2 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:07:17 user nova-compute[72184]: WARNING nova.compute.manager [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:07:17 user nova-compute[72184]: WARNING nova.compute.manager [req-12595dd8-d55d-4443-b54d-28ccd7588c0f req-c7502299-5e62-4b15-83de-f9736a2893d7 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state rescued and task_state unrescuing.
Aug 01 17:07:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909637.7408304, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:07:17 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Started (Lifecycle Event)
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:07:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:07:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:25 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909630.0666456, 90809a35-7659-492d-a605-e3b40e161bbf => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:07:25 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] VM Stopped (Lifecycle Event)
Aug 01 17:07:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9bf85cd5-876a-40da-9f4f-20964f011d95 None None] [instance: 90809a35-7659-492d-a605-e3b40e161bbf] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:07:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:07:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing instance network info cache due to event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:07:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:07:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:07:50 user nova-compute[72184]: DEBUG nova.network.neutron [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updated VIF entry in instance network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5c1069b9-0c50-4409-b418-e7a19e9e5392 req-c0167b78-4a71-4dae-b893-3add7f827167 service nova] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing instance network info cache due to event network-changed-a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] Acquiring lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] Acquired lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Refreshing network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:51 user nova-compute[72184]: INFO nova.compute.manager [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Detaching volume 8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1
Aug 01 17:07:51 user nova-compute[72184]: INFO nova.virt.block_device [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Attempting to driver detach volume 8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 from mountpoint /dev/vdb
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Attempting to detach device vdb from instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:07:51 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:07:51 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:07:51 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:07:51 user nova-compute[72184]:   <serial>8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1</serial>
Aug 01 17:07:51 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:07:51 user nova-compute[72184]: </disk>
Aug 01 17:07:51 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:07:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully detached device vdb from instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a from the persistent domain config.
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:07:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:07:51 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:07:51 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:07:51 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:07:51 user nova-compute[72184]:   <serial>8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1</serial>
Aug 01 17:07:51 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:07:51 user nova-compute[72184]: </disk>
Aug 01 17:07:51 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG nova.network.neutron [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updated VIF entry in instance network info cache for port a5f4f6cf-37a4-43ea-84df-e5461fa98990. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG nova.network.neutron [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [{"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909672.4739609, 612209a3-7d0f-44a3-b237-9bdccaab6d8a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-175ea62b-8438-4962-aba0-2ec031b70f0e req-f312973d-46b5-474e-a77b-20c536fa1919 service nova] Releasing lock "refresh_cache-612209a3-7d0f-44a3-b237-9bdccaab6d8a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:07:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully detached device vdb from instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a from the live domain config.
Aug 01 17:07:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBPZqHAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:07:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770a04f-bf74-46a8-b260-3c823d8b4c1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87a78985-aa06-45c3-b3c1-dbfdafd1db89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f9425-4539-4231-9c01-a9251280c4e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a78985-aa06-45c3-b3c1-dbfdafd1db89 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a78985-aa06-45c3-b3c1-dbfdafd1db89 (non-flash)
Aug 01 17:07:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:07:52 user nova-compute[72184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a78985-aa06-45c3-b3c1-dbfdafd1db89 (non-flash)
Aug 01 17:07:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301815f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab9a8cb-f40b-4299-9084-1c466254ca5d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4768552d-49c1-411c-9082-dc6dac5fd630]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097e3c1-68c3-4409-b9df-493a6dbcfc12]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabdd383-72e1-426b-bd1e-f185b952e120]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd48f65-7e3c-4e16-9982-8e4663320928]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:07:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.254s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba918fc-ea43-4db5-a76a-5ef235f9c0cc]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260]
Aug 01 17:07:53 user nova-compute[72184]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1, portal: 172.16.0.220,3260] successful.
Aug 01 17:07:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceccfa8-353f-4fd2-b65e-a2ab5567f0b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667bdfb-c10c-4702-8a8f-923b2671d586]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.617s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] <== disconnect_volume: return (617ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:07:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:07:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'flavor' on Instance uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:07:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4d03c79a-c7b3-4ed4-9622-970c6b883fe8 tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.575s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk.rescue --force-share --output=json" returned: 0 in 0.285s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:07:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:08:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7422MB free_disk=24.313236236572266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance a8b17402-c090-4e22-8ca7-06df5361d20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 52833ca5-abaa-44e7-90b1-3e18928101c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:08:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:08:03 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:08:03 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:08:03 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:08:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.036s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [{"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-75c3c16a-8768-4b24-8469-35b77664a71e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:08:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:08:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:08:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:08:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:08:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:13 user nova-compute[72184]: INFO nova.compute.manager [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Terminating instance
Aug 01 17:08:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-d25bd5dd-5e9e-4aa1-8ddb-691259f77abf req-c74dc674-e56d-4dee-ae95-75a127126f76 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d25bd5dd-5e9e-4aa1-8ddb-691259f77abf req-c74dc674-e56d-4dee-ae95-75a127126f76 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d25bd5dd-5e9e-4aa1-8ddb-691259f77abf req-c74dc674-e56d-4dee-ae95-75a127126f76 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d25bd5dd-5e9e-4aa1-8ddb-691259f77abf req-c74dc674-e56d-4dee-ae95-75a127126f76 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-d25bd5dd-5e9e-4aa1-8ddb-691259f77abf req-c74dc674-e56d-4dee-ae95-75a127126f76 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-d25bd5dd-5e9e-4aa1-8ddb-691259f77abf req-c74dc674-e56d-4dee-ae95-75a127126f76 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-unplugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:08:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Instance destroyed successfully.
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.objects.instance [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'resources' on Instance uuid a8b17402-c090-4e22-8ca7-06df5361d20c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556921540',display_name='tempest-ServerRescueNegativeTestJSON-server-1556921540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556921540',id=3,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:53:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-16ucxoey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:53:49Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=a8b17402-c090-4e22-8ca7-06df5361d20c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "address": "fa:16:3e:c4:f0:f6", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9529a526-86", "ovs_interfaceid": "9529a526-8677-4545-bd95-3fecdfa3c8ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG os_vif [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9529a526-86, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:14 user nova-compute[72184]: INFO os_vif [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=9529a526-8677-4545-bd95-3fecdfa3c8ed,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9529a526-86')
Aug 01 17:08:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Deleting instance files /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c_del
Aug 01 17:08:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Deletion of /opt/stack/data/nova/instances/a8b17402-c090-4e22-8ca7-06df5361d20c_del complete
Aug 01 17:08:14 user nova-compute[72184]: INFO nova.compute.manager [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 01 17:08:14 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:14 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Took 0.47 seconds to deallocate network for instance.
Aug 01 17:08:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:15 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Deleted allocations for instance a8b17402-c090-4e22-8ca7-06df5361d20c
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-96c7bf45-3f7a-4b1b-b21d-03fff63cf6e2 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] Acquiring lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] Lock "a8b17402-c090-4e22-8ca7-06df5361d20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] No waiting events found dispatching network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:15 user nova-compute[72184]: WARNING nova.compute.manager [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received unexpected event network-vif-plugged-9529a526-8677-4545-bd95-3fecdfa3c8ed for instance with vm_state deleted and task_state None.
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-2f118c8a-134b-44a8-8099-85b0f03282a7 req-d16956d3-3a8c-4695-8138-01823a2baa80 service nova] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Received event network-vif-deleted-9529a526-8677-4545-bd95-3fecdfa3c8ed {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 76785510-2f39-4b4f-a11c-d30f9cd82138 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 1ebe63cb-0db0-4cbf-b58b-71d07905c37d {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-changed-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Refreshing instance network info cache due to event network-changed-d8c311e0-0221-4d18-8579-f30e351d6ad5. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:08:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] Acquiring lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] Acquired lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:17 user nova-compute[72184]: DEBUG nova.network.neutron [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Refreshing network info cache for port d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:08:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updated VIF entry in instance network info cache for port d8c311e0-0221-4d18-8579-f30e351d6ad5. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:08:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b4595e6e-05ca-4163-b5ac-f787228a6bd0 req-380ecb6f-e6dc-458a-a4ab-4be2e54e9895 service nova] Releasing lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-changed-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Refreshing instance network info cache due to event network-changed-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Refreshing network info cache for port 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Stashing vm_state: active {{(pid=72184) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updated VIF entry in instance network info cache for port 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'pci_requests' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:08:20 user nova-compute[72184]: INFO nova.compute.claims [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Claim successful on node user
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'resources' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bd1b796e-fccd-448c-a5fc-d72d82945b36 req-6cce1cb6-661c-4893-a68c-a29a48fb31af service nova] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:20 user nova-compute[72184]: INFO nova.compute.resource_tracker [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating resource usage from migration c9229a4b-44d9-43a8-aa5d-ca20822827b8
Aug 01 17:08:21 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.455s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:21 user nova-compute[72184]: INFO nova.compute.manager [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Migrating
Aug 01 17:08:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Starting migrate_disk_and_power_off {{(pid=72184) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 17:08:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-d7ea8bf6-f0a2-4b05-a904-8f58df6194c8 req-92863026-cfa8-4e03-83b0-f6a45cd9513b service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d7ea8bf6-f0a2-4b05-a904-8f58df6194c8 req-92863026-cfa8-4e03-83b0-f6a45cd9513b service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d7ea8bf6-f0a2-4b05-a904-8f58df6194c8 req-92863026-cfa8-4e03-83b0-f6a45cd9513b service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d7ea8bf6-f0a2-4b05-a904-8f58df6194c8 req-92863026-cfa8-4e03-83b0-f6a45cd9513b service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-d7ea8bf6-f0a2-4b05-a904-8f58df6194c8 req-92863026-cfa8-4e03-83b0-f6a45cd9513b service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:22 user nova-compute[72184]: WARNING nova.compute.manager [req-d7ea8bf6-f0a2-4b05-a904-8f58df6194c8 req-92863026-cfa8-4e03-83b0-f6a45cd9513b service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_migrating.
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance destroyed successfully.
Aug 01 17:08:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1155008516',display_name='tempest-ServerActionsTestOtherA-server-1155008516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1155008516',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-d072894v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=0aa80855-fc9c-4fc3-9afc-42fff581a74e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a68d1d0-09, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:22 user nova-compute[72184]: INFO os_vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09')
Aug 01 17:08:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:08:22 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce368da-7957-409a-96d1-64577c883c17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc31ffb-cdb5-4267-8cca-f38531512fff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:22 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:22 user nova-compute[72184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:22 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:22 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:22 user nova-compute[72184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:22 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301846fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403cea2-fd28-47b4-8e45-ff7bc0d04729]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02786e-49b6-46cc-986c-8e59a14ca031]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7e743-f43e-4f81-aafe-c106aca54835]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b931c3-b29b-4e62-b309-92bf7ad90a51]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:08:22 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4704f262-0e3b-4ef2-93e6-532b60c0395f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12715e-ee8e-4fc3-81df-8cca739bbf38]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]
Aug 01 17:08:23 user nova-compute[72184]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.
Aug 01 17:08:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be65450e-f205-4ef7-a466-e3e29ac72d6d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== disconnect_volume: return (382ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Port 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f binding to destination host user is already ACTIVE {{(pid=72184) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:24 user nova-compute[72184]: WARNING nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_migrated.
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:24 user nova-compute[72184]: WARNING nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_migrated.
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:24 user nova-compute[72184]: WARNING nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_migrated.
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:24 user nova-compute[72184]: WARNING nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_migrated.
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:24 user nova-compute[72184]: WARNING nova.compute.manager [req-c5c6d5a1-332a-43c4-bf09-f4c6d5476b31 req-267c5530-07e0-4a93-bd7b-4e36985edace service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_migrated.
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:24 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG os_brick.utils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f86e27c-30aa-43d9-94da-6aff4810ed41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16db3154-9905-471d-9c09-70b1318bac3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdda7ba-f14e-47fc-abec-1001f3bc7d3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb91e7f-7cb2-4508-bee0-36e213b08ea6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:08:25 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:08:25 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23b2c1a-5315-449f-aa9d-7a42e3167fd0]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:08:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:08:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:08:26 user nova-compute[72184]: DEBUG os_brick.utils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:08:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909694.0448384, a8b17402-c090-4e22-8ca7-06df5361d20c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:08:29 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] VM Stopped (Lifecycle Event)
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:08:29 user nova-compute[72184]: INFO nova.compute.claims [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Claim successful on node user
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-30e3f6d6-d0f9-49ac-8fe0-e04262c57623 None None] [instance: a8b17402-c090-4e22-8ca7-06df5361d20c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:08:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.policy [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9eb59567b76e4f62ac8e1249731ec8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb89d5efe3f4ff0987f9b10903a0c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:08:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Creating image(s)
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "/opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "/opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.187s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.154s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk 1073741824" returned: 0 in 0.050s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Successfully created port: b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Cannot resize image /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lazy-loading 'migration_context' on Instance uuid 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Ensure instance console log exists: /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Successfully updated port: b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "refresh_cache-3a1b3c88-6f25-4cfe-b652-c45b6b409e22" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquired lock "refresh_cache-3a1b3c88-6f25-4cfe-b652-c45b6b409e22" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-changed-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Refreshing instance network info cache due to event network-changed-b35d4df1-582e-4d57-9725-4e7ef53e140e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] Acquiring lock "refresh_cache-3a1b3c88-6f25-4cfe-b652-c45b6b409e22" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.network.neutron [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Updating instance_info_cache with network_info: [{"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Releasing lock "refresh_cache-3a1b3c88-6f25-4cfe-b652-c45b6b409e22" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Instance network_info: |[{"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] Acquired lock "refresh_cache-3a1b3c88-6f25-4cfe-b652-c45b6b409e22" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Refreshing network info cache for port b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Start _get_guest_xml network_info=[{"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:08:31 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:08:31 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:08:31 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-661178526',display_name='tempest-VolumesNegativeTest-instance-661178526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-661178526',id=35,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bb89d5efe3f4ff0987f9b10903a0c7c',ramdisk_id='',reservation_id='r-f078ejo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-439547468',owner_user_name='tempest-VolumesNegativeTest-439547468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:08:30Z,user_data=None,user_id='9eb59567b76e4f62ac8e1249731ec8d6',uuid=3a1b3c88-6f25-4cfe-b652-c45b6b409e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Converting VIF {"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:08:32 user nova-compute[72184]:   <uuid>3a1b3c88-6f25-4cfe-b652-c45b6b409e22</uuid>
Aug 01 17:08:32 user nova-compute[72184]:   <name>instance-00000023</name>
Aug 01 17:08:32 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:08:32 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:08:32 user nova-compute[72184]:   <metadata>
Aug 01 17:08:32 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:08:32 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:08:32 user nova-compute[72184]:       <nova:name>tempest-VolumesNegativeTest-instance-661178526</nova:name>
Aug 01 17:08:32 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:08:31</nova:creationTime>
Aug 01 17:08:32 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:08:32 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:08:32 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:08:32 user nova-compute[72184]:       <nova:owner>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:user uuid="9eb59567b76e4f62ac8e1249731ec8d6">tempest-VolumesNegativeTest-439547468-project-member</nova:user>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:project uuid="9bb89d5efe3f4ff0987f9b10903a0c7c">tempest-VolumesNegativeTest-439547468</nova:project>
Aug 01 17:08:32 user nova-compute[72184]:       </nova:owner>
Aug 01 17:08:32 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:08:32 user nova-compute[72184]:       <nova:ports>
Aug 01 17:08:32 user nova-compute[72184]:         <nova:port uuid="b35d4df1-582e-4d57-9725-4e7ef53e140e">
Aug 01 17:08:32 user nova-compute[72184]:           <nova:ip type="fixed" address="192.168.233.5" ipVersion="4"/>
Aug 01 17:08:32 user nova-compute[72184]:         </nova:port>
Aug 01 17:08:32 user nova-compute[72184]:       </nova:ports>
Aug 01 17:08:32 user nova-compute[72184]:     </nova:instance>
Aug 01 17:08:32 user nova-compute[72184]:   </metadata>
Aug 01 17:08:32 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:08:32 user nova-compute[72184]:     <system>
Aug 01 17:08:32 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:08:32 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:08:32 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:08:32 user nova-compute[72184]:       <entry name="serial">3a1b3c88-6f25-4cfe-b652-c45b6b409e22</entry>
Aug 01 17:08:32 user nova-compute[72184]:       <entry name="uuid">3a1b3c88-6f25-4cfe-b652-c45b6b409e22</entry>
Aug 01 17:08:32 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:08:32 user nova-compute[72184]:     </system>
Aug 01 17:08:32 user nova-compute[72184]:   </sysinfo>
Aug 01 17:08:32 user nova-compute[72184]:   <os>
Aug 01 17:08:32 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:08:32 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:08:32 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:08:32 user nova-compute[72184]:   </os>
Aug 01 17:08:32 user nova-compute[72184]:   <features>
Aug 01 17:08:32 user nova-compute[72184]:     <acpi/>
Aug 01 17:08:32 user nova-compute[72184]:     <apic/>
Aug 01 17:08:32 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:08:32 user nova-compute[72184]:   </features>
Aug 01 17:08:32 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:08:32 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:08:32 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:08:32 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:08:32 user nova-compute[72184]:   </clock>
Aug 01 17:08:32 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:08:32 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:08:32 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:08:32 user nova-compute[72184]:   </cpu>
Aug 01 17:08:32 user nova-compute[72184]:   <devices>
Aug 01 17:08:32 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:08:32 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:08:32 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk"/>
Aug 01 17:08:32 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:08:32 user nova-compute[72184]:     </disk>
Aug 01 17:08:32 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:08:32 user nova-compute[72184]:       <mac address="fa:16:3e:4d:2b:06"/>
Aug 01 17:08:32 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:08:32 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:08:32 user nova-compute[72184]:       <target dev="tapb35d4df1-58"/>
Aug 01 17:08:32 user nova-compute[72184]:     </interface>
Aug 01 17:08:32 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:08:32 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/console.log" append="off"/>
Aug 01 17:08:32 user nova-compute[72184]:     </serial>
Aug 01 17:08:32 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:08:32 user nova-compute[72184]:     <video>
Aug 01 17:08:32 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:08:32 user nova-compute[72184]:     </video>
Aug 01 17:08:32 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:08:32 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:08:32 user nova-compute[72184]:     </rng>
Aug 01 17:08:32 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:08:32 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:08:32 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:08:32 user nova-compute[72184]:     </memballoon>
Aug 01 17:08:32 user nova-compute[72184]:   </devices>
Aug 01 17:08:32 user nova-compute[72184]: </domain>
Aug 01 17:08:32 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-661178526',display_name='tempest-VolumesNegativeTest-instance-661178526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-661178526',id=35,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bb89d5efe3f4ff0987f9b10903a0c7c',ramdisk_id='',reservation_id='r-f078ejo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-439547468',owner_user_name='tempest-VolumesNegativeTest-439547468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:08:30Z,user_data=None,user_id='9eb59567b76e4f62ac8e1249731ec8d6',uuid=3a1b3c88-6f25-4cfe-b652-c45b6b409e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Converting VIF {"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG os_vif [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb35d4df1-58, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb35d4df1-58, col_values=(('external_ids', {'iface-id': 'b35d4df1-582e-4d57-9725-4e7ef53e140e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:2b:06', 'vm-uuid': '3a1b3c88-6f25-4cfe-b652-c45b6b409e22'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:32 user nova-compute[72184]: INFO os_vif [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58')
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] No VIF found with MAC fa:16:3e:4d:2b:06, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Updated VIF entry in instance network info cache for port b35d4df1-582e-4d57-9725-4e7ef53e140e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG nova.network.neutron [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Updating instance_info_cache with network_info: [{"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-25ed486f-ab93-41cf-b035-df8b7145e7b6 req-c648a2dc-7449-4acb-82ef-bc7b5df79846 service nova] Releasing lock "refresh_cache-3a1b3c88-6f25-4cfe-b652-c45b6b409e22" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-df52fe3f-7d1e-41fa-81a5-afc0efcc448d req-5b36714f-9451-43f8-ad67-2f62d9a67335 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-df52fe3f-7d1e-41fa-81a5-afc0efcc448d req-5b36714f-9451-43f8-ad67-2f62d9a67335 service nova] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-df52fe3f-7d1e-41fa-81a5-afc0efcc448d req-5b36714f-9451-43f8-ad67-2f62d9a67335 service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-df52fe3f-7d1e-41fa-81a5-afc0efcc448d req-5b36714f-9451-43f8-ad67-2f62d9a67335 service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-df52fe3f-7d1e-41fa-81a5-afc0efcc448d req-5b36714f-9451-43f8-ad67-2f62d9a67335 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] No waiting events found dispatching network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:34 user nova-compute[72184]: WARNING nova.compute.manager [req-df52fe3f-7d1e-41fa-81a5-afc0efcc448d req-5b36714f-9451-43f8-ad67-2f62d9a67335 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received unexpected event network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e for instance with vm_state building and task_state spawning.
Aug 01 17:08:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Starting finish_migration {{(pid=72184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance directory exists: not creating {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 17:08:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Creating image(s)
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa80855-fc9c-4fc3-9afc-42fff581a74e/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Start _get_guest_xml network_info=[{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '3b36e408-a266-4d56-b30f-6bbbb27d9d8e', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0aa80855-fc9c-4fc3-9afc-42fff581a74e', 'attached_at': '2023-08-01T17:08:34.000000', 'detached_at': '', 'volume_id': '539640be-b67b-4c4c-828f-1549014677be', 'serial': '539640be-b67b-4c4c-828f-1549014677be'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:08:34 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:08:34 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:48:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:08:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:08:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:08:34 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a9356-c3df-4c5a-9401-1d2fa5ad099f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:08:34 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f8491-b319-43f4-ac5d-125e92984cf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be] added
Aug 01 17:08:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1068060-6c5b-4a66-a3d7-4528a6cc5317]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b40cb-d553-472b-ab18-f24c1ab1fcb1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkiUftyG {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkiUftyG" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c2a44-7b58-4be2-b752-52131df13919]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkiUftyG'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b114137b-52a7-45f5-b12d-73ef11e2c494]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa69dc2-ae10-476f-a28e-52986e0f4792]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b337e308-0a7b-4983-8e54-20dfbfd567b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]
Aug 01 17:08:35 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.
Aug 01 17:08:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fece7a3-67d4-4cd3-a6f7-8449b9e6ec57]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c38f4d-b58e-49e4-8c82-1f36b77f3700]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:35 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:35 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:35 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:35 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48771f5-04b1-41dd-858f-e05094fc786d]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:08:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909716.1102307, 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] VM Resumed (Lifecycle Event)
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Instance spawned successfully.
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-fbd98be9-9b96-4604-8007-f5a3e6922292 req-44df1f40-c344-497a-a428-5add1d461e29 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fbd98be9-9b96-4604-8007-f5a3e6922292 req-44df1f40-c344-497a-a428-5add1d461e29 service nova] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fbd98be9-9b96-4604-8007-f5a3e6922292 req-44df1f40-c344-497a-a428-5add1d461e29 service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fbd98be9-9b96-4604-8007-f5a3e6922292 req-44df1f40-c344-497a-a428-5add1d461e29 service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-fbd98be9-9b96-4604-8007-f5a3e6922292 req-44df1f40-c344-497a-a428-5add1d461e29 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] No waiting events found dispatching network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:36 user nova-compute[72184]: WARNING nova.compute.manager [req-fbd98be9-9b96-4604-8007-f5a3e6922292 req-44df1f40-c344-497a-a428-5add1d461e29 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received unexpected event network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e for instance with vm_state building and task_state spawning.
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909716.1125858, 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] VM Started (Lifecycle Event)
Aug 01 17:08:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26166636562366339', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166636562366339', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1155008516',display_name='tempest-ServerActionsTestOtherA-server-1155008516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1155008516',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-d072894v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=0aa80855-fc9c-4fc3-9afc-42fff581a74e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:08:36 user nova-compute[72184]:   <uuid>0aa80855-fc9c-4fc3-9afc-42fff581a74e</uuid>
Aug 01 17:08:36 user nova-compute[72184]:   <name>instance-00000021</name>
Aug 01 17:08:36 user nova-compute[72184]:   <memory>2097152</memory>
Aug 01 17:08:36 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:08:36 user nova-compute[72184]:   <metadata>
Aug 01 17:08:36 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:08:36 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:08:36 user nova-compute[72184]:       <nova:name>tempest-ServerActionsTestOtherA-server-1155008516</nova:name>
Aug 01 17:08:36 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:08:34</nova:creationTime>
Aug 01 17:08:36 user nova-compute[72184]:       <nova:flavor name="m1.small">
Aug 01 17:08:36 user nova-compute[72184]:         <nova:memory>2048</nova:memory>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:disk>20</nova:disk>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:08:36 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:08:36 user nova-compute[72184]:       <nova:owner>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:user uuid="09d472678ed94cb7ab09de7d72128f84">tempest-ServerActionsTestOtherA-2143698002-project-member</nova:user>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:project uuid="3ef0982d76ca40a48b457e0797d6837b">tempest-ServerActionsTestOtherA-2143698002</nova:project>
Aug 01 17:08:36 user nova-compute[72184]:       </nova:owner>
Aug 01 17:08:36 user nova-compute[72184]:       <nova:ports>
Aug 01 17:08:36 user nova-compute[72184]:         <nova:port uuid="1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f">
Aug 01 17:08:36 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 17:08:36 user nova-compute[72184]:         </nova:port>
Aug 01 17:08:36 user nova-compute[72184]:       </nova:ports>
Aug 01 17:08:36 user nova-compute[72184]:     </nova:instance>
Aug 01 17:08:36 user nova-compute[72184]:   </metadata>
Aug 01 17:08:36 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:08:36 user nova-compute[72184]:     <system>
Aug 01 17:08:36 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:08:36 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:08:36 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:08:36 user nova-compute[72184]:       <entry name="serial">0aa80855-fc9c-4fc3-9afc-42fff581a74e</entry>
Aug 01 17:08:36 user nova-compute[72184]:       <entry name="uuid">0aa80855-fc9c-4fc3-9afc-42fff581a74e</entry>
Aug 01 17:08:36 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:08:36 user nova-compute[72184]:     </system>
Aug 01 17:08:36 user nova-compute[72184]:   </sysinfo>
Aug 01 17:08:36 user nova-compute[72184]:   <os>
Aug 01 17:08:36 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:08:36 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:08:36 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:08:36 user nova-compute[72184]:   </os>
Aug 01 17:08:36 user nova-compute[72184]:   <features>
Aug 01 17:08:36 user nova-compute[72184]:     <acpi/>
Aug 01 17:08:36 user nova-compute[72184]:     <apic/>
Aug 01 17:08:36 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:08:36 user nova-compute[72184]:   </features>
Aug 01 17:08:36 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:08:36 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:08:36 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:08:36 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:08:36 user nova-compute[72184]:   </clock>
Aug 01 17:08:36 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:08:36 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:08:36 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:08:36 user nova-compute[72184]:   </cpu>
Aug 01 17:08:36 user nova-compute[72184]:   <devices>
Aug 01 17:08:36 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:08:36 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:08:36 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 17:08:36 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:08:36 user nova-compute[72184]:       <serial>539640be-b67b-4c4c-828f-1549014677be</serial>
Aug 01 17:08:36 user nova-compute[72184]:     </disk>
Aug 01 17:08:36 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:08:36 user nova-compute[72184]:       <mac address="fa:16:3e:df:ac:1c"/>
Aug 01 17:08:36 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:08:36 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:08:36 user nova-compute[72184]:       <target dev="tap1a68d1d0-09"/>
Aug 01 17:08:36 user nova-compute[72184]:     </interface>
Aug 01 17:08:36 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:08:36 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/0aa80855-fc9c-4fc3-9afc-42fff581a74e/console.log" append="off"/>
Aug 01 17:08:36 user nova-compute[72184]:     </serial>
Aug 01 17:08:36 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:08:36 user nova-compute[72184]:     <video>
Aug 01 17:08:36 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:08:36 user nova-compute[72184]:     </video>
Aug 01 17:08:36 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:08:36 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:08:36 user nova-compute[72184]:     </rng>
Aug 01 17:08:36 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:08:36 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:08:36 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:08:36 user nova-compute[72184]:     </memballoon>
Aug 01 17:08:36 user nova-compute[72184]:   </devices>
Aug 01 17:08:36 user nova-compute[72184]: </domain>
Aug 01 17:08:36 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1155008516',display_name='tempest-ServerActionsTestOtherA-server-1155008516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1155008516',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-d072894v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=0aa80855-fc9c-4fc3-9afc-42fff581a74e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1388458535-network", "vif_mac": "fa:16:3e:df:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG os_vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a68d1d0-09, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a68d1d0-09, col_values=(('external_ids', {'iface-id': '1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ac:1c', 'vm-uuid': '0aa80855-fc9c-4fc3-9afc-42fff581a74e'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:36 user nova-compute[72184]: INFO os_vif [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09')
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:08:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] No VIF found with MAC fa:16:3e:df:ac:1c, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:08:36 user nova-compute[72184]: INFO nova.compute.manager [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Took 7.40 seconds to build instance.
Aug 01 17:08:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ec0d22be-993b-4fa6-b4ca-38705abbd9d7 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.513s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:37 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909702.6998272, 0aa80855-fc9c-4fc3-9afc-42fff581a74e => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:08:37 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] VM Stopped (Lifecycle Event)
Aug 01 17:08:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8483a59-1bee-4561-87ae-168185deb6e8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-a90e46d9-bf92-42be-bb7c-c640f718021e req-434799ed-3656-49fe-b388-1772b9038b23 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a90e46d9-bf92-42be-bb7c-c640f718021e req-434799ed-3656-49fe-b388-1772b9038b23 service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a90e46d9-bf92-42be-bb7c-c640f718021e req-434799ed-3656-49fe-b388-1772b9038b23 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a90e46d9-bf92-42be-bb7c-c640f718021e req-434799ed-3656-49fe-b388-1772b9038b23 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-a90e46d9-bf92-42be-bb7c-c640f718021e req-434799ed-3656-49fe-b388-1772b9038b23 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:38 user nova-compute[72184]: WARNING nova.compute.manager [req-a90e46d9-bf92-42be-bb7c-c640f718021e req-434799ed-3656-49fe-b388-1772b9038b23 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_finish.
Aug 01 17:08:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-changed-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Refreshing instance network info cache due to event network-changed-2d43cfa7-0928-4571-8e6c-1fd4108cb358. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] Acquiring lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] Acquired lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Refreshing network info cache for port 2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'flavor' on Instance uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909720.3213298, 0aa80855-fc9c-4fc3-9afc-42fff581a74e => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] VM Resumed (Lifecycle Event)
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Ignoring supplied device name: /dev/vdb
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance running successfully.
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-fc7ae154-86ac-446f-bfa6-a7d061fa8377 req-e9d7d1b8-389d-4300-a53d-35cb557137a8 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fc7ae154-86ac-446f-bfa6-a7d061fa8377 req-e9d7d1b8-389d-4300-a53d-35cb557137a8 service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fc7ae154-86ac-446f-bfa6-a7d061fa8377 req-e9d7d1b8-389d-4300-a53d-35cb557137a8 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fc7ae154-86ac-446f-bfa6-a7d061fa8377 req-e9d7d1b8-389d-4300-a53d-35cb557137a8 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-fc7ae154-86ac-446f-bfa6-a7d061fa8377 req-e9d7d1b8-389d-4300-a53d-35cb557137a8 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:40 user nova-compute[72184]: WARNING nova.compute.manager [req-fc7ae154-86ac-446f-bfa6-a7d061fa8377 req-e9d7d1b8-389d-4300-a53d-35cb557137a8 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state resize_finish.
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Failed to set time: agent not configured {{(pid=72184) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6196748e-a601-41c6-b68b-58f175698d9c tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] finish_migration finished successfully. {{(pid=72184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909720.325374, 0aa80855-fc9c-4fc3-9afc-42fff581a74e => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] VM Started (Lifecycle Event)
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updated VIF entry in instance network info cache for port 2d43cfa7-0928-4571-8e6c-1fd4108cb358. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updating instance_info_cache with network_info: [{"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a81d37af-cc99-4a00-9157-26e5706e70d0 req-90f225d6-f5b8-4212-8e68-e6ad441ae06d service nova] Releasing lock "refresh_cache-8e5746d0-f2bb-4523-9517-7c8817fd2811" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:40 user nova-compute[72184]: INFO nova.compute.manager [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Attaching volume 8c1d0225-ee16-49d0-a3ff-b4a14919ec2c to /dev/vdb
Aug 01 17:08:40 user nova-compute[72184]: DEBUG os_brick.utils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec52eec-fd0b-4d6c-a20c-be3bc76dc31c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ef18a-fc23-4043-bf8c-b947d1ab4fd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ec51c-9475-4396-93eb-777a145295bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c949f-600e-44c9-aca9-a123dab07f9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:08:40 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:08:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b910a17-7268-4314-930d-afc6c342de8f]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG os_brick.utils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:08:40 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updating existing volume attachment record: 5146d48c-f851-427d-8cee-8b3445a7fe26 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:08:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDsmHgFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:08:49 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:08:49 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:08:49 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85014964-d2ab-4714-b885-0401eef13b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:08:49 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d20d4f-1cb4-4c9c-96b7-9a58697adc05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c] added
Aug 01 17:08:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43e78d-b98a-49ae-ab0f-7e693999abed]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2dc2c5-d832-4f8d-82b7-2ddaad753a58]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDsmHgFP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDsmHgFP" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d5128e-2c7a-4076-820a-ad308c7fcf43]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDsmHgFP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7490745-90fb-451d-9e46-2a43f7bb93a0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7717cfb4-aa77-4000-aff1-f0f74f7279e6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b4071-d210-4933-8f51-703b52853c61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260]
Aug 01 17:08:49 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260] successful.
Aug 01 17:08:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[527674e0-a04d-486a-a857-35c18f803e69]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a88711-773d-4127-aa0d-bffeb4ca20d8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:08:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:08:49 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:08:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e0667-40ae-4905-9a90-62836fdfea88]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:08:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDsmHgFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23534643631376237', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534643631376237', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'flavor' on Instance uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:08:50 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:08:50 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:08:50 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:08:50 user nova-compute[72184]:   <serial>8c1d0225-ee16-49d0-a3ff-b4a14919ec2c</serial>
Aug 01 17:08:50 user nova-compute[72184]: </disk>
Aug 01 17:08:50 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:08:50 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:08:51 user nova-compute[72184]: INFO nova.compute.claims [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Claim successful on node user
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] No VIF found with MAC fa:16:3e:f2:32:c5, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f725f2cd-6569-44bb-ae64-ebee6061fb56 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.942s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.network.neutron [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:08:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:08:51 user nova-compute[72184]: INFO nova.virt.block_device [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Booting with volume snapshot e518191b-b733-4d90-b214-ae116dddad98 at /dev/vda
Aug 01 17:08:51 user nova-compute[72184]: DEBUG nova.policy [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce144879b7e4638822f0d7174693575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf5145289cf4667b9398df4a8266bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Successfully created port: 08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:08:52 user nova-compute[72184]: INFO nova.compute.manager [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Terminating instance
Aug 01 17:08:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-e3d59fec-cc0d-4d04-b0e7-62096a34b958 req-809d67e3-f0c7-4f54-b28b-84b2ab23dbdb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-unplugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e3d59fec-cc0d-4d04-b0e7-62096a34b958 req-809d67e3-f0c7-4f54-b28b-84b2ab23dbdb service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e3d59fec-cc0d-4d04-b0e7-62096a34b958 req-809d67e3-f0c7-4f54-b28b-84b2ab23dbdb service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e3d59fec-cc0d-4d04-b0e7-62096a34b958 req-809d67e3-f0c7-4f54-b28b-84b2ab23dbdb service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-e3d59fec-cc0d-4d04-b0e7-62096a34b958 req-809d67e3-f0c7-4f54-b28b-84b2ab23dbdb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-unplugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-e3d59fec-cc0d-4d04-b0e7-62096a34b958 req-809d67e3-f0c7-4f54-b28b-84b2ab23dbdb service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-unplugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Instance destroyed successfully.
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lazy-loading 'resources' on Instance uuid 612209a3-7d0f-44a3-b237-9bdccaab6d8a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1017071891',display_name='tempest-TestMinimumBasicScenario-server-1017071891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1017071891',id=31,image_ref='2801757d-6cdd-420e-9f69-7ce7def516c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZsCF9VvfIlh/s49Wj40qHeGG3DyV12dg5QiT1liFzyMkukD2Qhqj6OoK1ijQfns4qAhlfkNCOrGzJHH6Locgm8IkHfbz8/ZnIK9rlg9nd0rVlSUNYbSyPo1cyp0G/N0g==',key_name='tempest-TestMinimumBasicScenario-1856804338',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:03:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d793a9d1897f42be86ed38b4dff4f977',ramdisk_id='',reservation_id='r-abwkm3p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2801757d-6cdd-420e-9f69-7ce7def516c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-582463682',owner_user_name='tempest-TestMinimumBasicScenario-582463682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:06:06Z,user_data=None,user_id='9ae2243c375e4f23a9bb9d3abaab63cc',uuid=612209a3-7d0f-44a3-b237-9bdccaab6d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converting VIF {"id": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "address": "fa:16:3e:5e:96:39", "network": {"id": "cd155d4c-8d36-478d-8dd5-f990f19ed748", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1993354859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d793a9d1897f42be86ed38b4dff4f977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f4f6cf-37", "ovs_interfaceid": "a5f4f6cf-37a4-43ea-84df-e5461fa98990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG os_vif [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5f4f6cf-37, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:08:53 user nova-compute[72184]: INFO os_vif [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a5f4f6cf-37a4-43ea-84df-e5461fa98990,network=Network(cd155d4c-8d36-478d-8dd5-f990f19ed748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f4f6cf-37')
Aug 01 17:08:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Deleting instance files /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a_del
Aug 01 17:08:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Deletion of /opt/stack/data/nova/instances/612209a3-7d0f-44a3-b237-9bdccaab6d8a_del complete
Aug 01 17:08:53 user nova-compute[72184]: INFO nova.compute.manager [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 17:08:53 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Successfully updated port: 08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "refresh_cache-5c54cfde-9fa0-4499-85f5-93c9c517f06a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquired lock "refresh_cache-5c54cfde-9fa0-4499-85f5-93c9c517f06a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:08:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:08:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Updating instance_info_cache with network_info: [{"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Releasing lock "refresh_cache-5c54cfde-9fa0-4499-85f5-93c9c517f06a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:54 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Instance network_info: |[{"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:08:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] Acquiring lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] No waiting events found dispatching network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:08:55 user nova-compute[72184]: WARNING nova.compute.manager [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received unexpected event network-vif-plugged-a5f4f6cf-37a4-43ea-84df-e5461fa98990 for instance with vm_state active and task_state deleting.
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-changed-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Refreshing instance network info cache due to event network-changed-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] Acquiring lock "refresh_cache-5c54cfde-9fa0-4499-85f5-93c9c517f06a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] Acquired lock "refresh_cache-5c54cfde-9fa0-4499-85f5-93c9c517f06a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Refreshing network info cache for port 08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-cf222922-cb18-4f90-a782-e9436268fe55 req-82861d79-cd5d-415b-8cf5-eb4c5b740d97 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Received event network-vif-deleted-a5f4f6cf-37a4-43ea-84df-e5461fa98990 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:08:55 user nova-compute[72184]: INFO nova.compute.manager [req-cf222922-cb18-4f90-a782-e9436268fe55 req-82861d79-cd5d-415b-8cf5-eb4c5b740d97 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Neutron deleted interface a5f4f6cf-37a4-43ea-84df-e5461fa98990; detaching it from the instance and deleting it from the info cache
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-cf222922-cb18-4f90-a782-e9436268fe55 req-82861d79-cd5d-415b-8cf5-eb4c5b740d97 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:55 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Took 1.62 seconds to deallocate network for instance.
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-cf222922-cb18-4f90-a782-e9436268fe55 req-82861d79-cd5d-415b-8cf5-eb4c5b740d97 service nova] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Detach interface failed, port_id=a5f4f6cf-37a4-43ea-84df-e5461fa98990, reason: Instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Updated VIF entry in instance network info cache for port 08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG nova.network.neutron [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Updating instance_info_cache with network_info: [{"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e256a314-3469-4d2c-8f45-d43114973f44 req-f4669001-bb87-45e9-8fd8-fdbaaf45f23a service nova] Releasing lock "refresh_cache-5c54cfde-9fa0-4499-85f5-93c9c517f06a" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:08:55 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Deleted allocations for instance 612209a3-7d0f-44a3-b237-9bdccaab6d8a
Aug 01 17:08:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-eb6a6fe7-262b-441c-9a9e-b22759b2cc3f tempest-TestMinimumBasicScenario-582463682 tempest-TestMinimumBasicScenario-582463682-project-member] Lock "612209a3-7d0f-44a3-b237-9bdccaab6d8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.239s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:08:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:00 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:09:00 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=25.04681396484375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Applying migration context for instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e as it has an incoming, in-progress migration c9229a4b-44d9-43a8-aa5d-ca20822827b8. Migration status is finished {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 17:09:00 user nova-compute[72184]: INFO nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating resource usage from migration c9229a4b-44d9-43a8-aa5d-ca20822827b8
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 75c3c16a-8768-4b24-8469-35b77664a71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 52833ca5-abaa-44e7-90b1-3e18928101c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Migration c9229a4b-44d9-43a8-aa5d-ca20822827b8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5c54cfde-9fa0-4499-85f5-93c9c517f06a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:09:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:09:01 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:09:01 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:09:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:09:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG os_brick.utils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a619165a-092c-45e3-8acc-a970ba47ec95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d87b8-ebc2-4642-a21e-ed4336656d56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee3317e-0567-40cb-8f96-ce91d8509a80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d44592-1524-451b-aa85-5e675a908e28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:09:02 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:09:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc201ae-b034-485c-bc29-9cc8fbcc5cdd]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG os_brick.utils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:09:02 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Updating existing volume attachment record: 67b75194-900f-4502-885d-e53e1a6ab70e {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:09:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:04 user nova-compute[72184]: INFO nova.compute.manager [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Terminating instance
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9a17eba-3bd2-40cc-a1a6-a073396c02c2 req-b619fed2-fd05-444d-929c-69780812e6e8 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9a17eba-3bd2-40cc-a1a6-a073396c02c2 req-b619fed2-fd05-444d-929c-69780812e6e8 service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9a17eba-3bd2-40cc-a1a6-a073396c02c2 req-b619fed2-fd05-444d-929c-69780812e6e8 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9a17eba-3bd2-40cc-a1a6-a073396c02c2 req-b619fed2-fd05-444d-929c-69780812e6e8 service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9a17eba-3bd2-40cc-a1a6-a073396c02c2 req-b619fed2-fd05-444d-929c-69780812e6e8 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9a17eba-3bd2-40cc-a1a6-a073396c02c2 req-b619fed2-fd05-444d-929c-69780812e6e8 service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-unplugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:04 user nova-compute[72184]: INFO nova.compute.manager [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Terminating instance
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Instance destroyed successfully.
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.objects.instance [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lazy-loading 'resources' on Instance uuid 75c3c16a-8768-4b24-8469-35b77664a71e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1697013999',display_name='tempest-ServerRescueNegativeTestJSON-server-1697013999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1697013999',id=2,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a62e50ced845abbadbe12339265fdc',ramdisk_id='',reservation_id='r-p32h0ws3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-353659352',owner_user_name='tempest-ServerRescueNegativeTestJSON-353659352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:58:34Z,user_data=None,user_id='b0e33dc89b5744c2ad3c0d86f759c9c3',uuid=75c3c16a-8768-4b24-8469-35b77664a71e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converting VIF {"id": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "address": "fa:16:3e:da:95:ed", "network": {"id": "59fc8ef5-a970-4659-bb43-6d91723b34c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-307640045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a62e50ced845abbadbe12339265fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc34cd3a-a1", "ovs_interfaceid": "cc34cd3a-a1e6-4473-9679-b45d861b80ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG os_vif [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc34cd3a-a1, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: INFO os_vif [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:95:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc34cd3a-a1e6-4473-9679-b45d861b80ac,network=Network(59fc8ef5-a970-4659-bb43-6d91723b34c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc34cd3a-a1')
Aug 01 17:09:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Deleting instance files /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e_del
Aug 01 17:09:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Deletion of /opt/stack/data/nova/instances/75c3c16a-8768-4b24-8469-35b77664a71e_del complete
Aug 01 17:09:04 user nova-compute[72184]: INFO nova.compute.manager [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 01 17:09:04 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Instance destroyed successfully.
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.objects.instance [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'resources' on Instance uuid 52833ca5-abaa-44e7-90b1-3e18928101c2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1665417027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1665417027',id=30,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-znime3vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:07:18Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=52833ca5-abaa-44e7-90b1-3e18928101c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "address": "fa:16:3e:fc:5b:a4", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732c42b3-c7", "ovs_interfaceid": "732c42b3-c7fa-46d8-aa0f-fea08031e568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_vif [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-3332c3a2-a46e-43a0-8341-24404cbed9e9 req-66a8a17c-935c-4f2e-8f34-78bda066823b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-deleted-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.compute.manager [req-3332c3a2-a46e-43a0-8341-24404cbed9e9 req-66a8a17c-935c-4f2e-8f34-78bda066823b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Neutron deleted interface cc34cd3a-a1e6-4473-9679-b45d861b80ac; detaching it from the instance and deleting it from the info cache
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-3332c3a2-a46e-43a0-8341-24404cbed9e9 req-66a8a17c-935c-4f2e-8f34-78bda066823b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Took 0.59 seconds to deallocate network for instance.
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap732c42b3-c7, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:09:05 user nova-compute[72184]: INFO os_vif [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5b:a4,bridge_name='br-int',has_traffic_filtering=True,id=732c42b3-c7fa-46d8-aa0f-fea08031e568,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732c42b3-c7')
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpazWRjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:09:05 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-3332c3a2-a46e-43a0-8341-24404cbed9e9 req-66a8a17c-935c-4f2e-8f34-78bda066823b service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Detach interface failed, port_id=cc34cd3a-a1e6-4473-9679-b45d861b80ac, reason: Instance 75c3c16a-8768-4b24-8469-35b77664a71e could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b0ac22-ae3f-44ea-86b0-f879297eec43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[464cec05-96d7-484b-8ff4-cfa06895438a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:05 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:09:05 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:05 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:05 user nova-compute[72184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd (non-flash)
Aug 01 17:09:05 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:05 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff84c0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f53f22-bf41-4d0c-b318-51ec2c25b068]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[104de277-6002-4a6b-8033-4da8fadafa64]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b0a52-0dce-4935-983d-22f2264d4910]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [{"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-76785510-2f39-4b4f-a11c-d30f9cd82138" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02fe48c-3b59-4244-baef-0f5d9cc26a3c]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO161bb995-9b96e477b6ac1ee4', '/dev/disk/by-id/scsi-23962393665343737', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_161bb995') {{(pid=83397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1886ee-0d22-476f-bfe9-254e1a6e29b4]: (4, None) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be063e8d-cd17-4601-becd-7e5946fef556]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9722ef-6382-48a4-8e38-2b9aeaab2bc0]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260]
Aug 01 17:09:05 user nova-compute[72184]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd, portal: 172.16.0.220,3260] successful.
Aug 01 17:09:05 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed70de59-236b-495b-a329-0fcd626c77dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b82457-e120-438f-a1bf-6fb6caeffb2a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== disconnect_volume: return (349ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Deleting instance files /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2_del
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Deletion of /opt/stack/data/nova/instances/52833ca5-abaa-44e7-90b1-3e18928101c2_del complete
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.compute.manager [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:05 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Deleted allocations for instance 75c3c16a-8768-4b24-8469-35b77664a71e
Aug 01 17:09:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-477218a6-3671-4690-b549-fb1920ef48e5 tempest-ServerRescueNegativeTestJSON-353659352 tempest-ServerRescueNegativeTestJSON-353659352-project-member] Lock "75c3c16a-8768-4b24-8469-35b77664a71e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Acquiring lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Lock "75c3c16a-8768-4b24-8469-35b77664a71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] No waiting events found dispatching network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:06 user nova-compute[72184]: WARNING nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Received unexpected event network-vif-plugged-cc34cd3a-a1e6-4473-9679-b45d861b80ac for instance with vm_state deleted and task_state None.
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-unplugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Acquiring lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] No waiting events found dispatching network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:06 user nova-compute[72184]: WARNING nova.compute.manager [req-0fe615fb-78db-441c-ac28-8b60ead75d4c req-6a801256-f1af-4c09-9dce-d954ccec96dd service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received unexpected event network-vif-plugged-732c42b3-c7fa-46d8-aa0f-fea08031e568 for instance with vm_state active and task_state deleting.
Aug 01 17:09:06 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:06 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Took 0.67 seconds to deallocate network for instance.
Aug 01 17:09:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:08 user nova-compute[72184]: DEBUG nova.compute.manager [req-6b0506b3-b0ce-41cd-8ca4-ff2cd6ee9278 req-e97b37cb-2cca-4379-8b1d-561fea895af9 service nova] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Received event network-vif-deleted-732c42b3-c7fa-46d8-aa0f-fea08031e568 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:08 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909733.4628963, 612209a3-7d0f-44a3-b237-9bdccaab6d8a => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:09:08 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] VM Stopped (Lifecycle Event)
Aug 01 17:09:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4aaad695-bee3-4c59-9d04-59a42481dcfb None None] [instance: 612209a3-7d0f-44a3-b237-9bdccaab6d8a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:08 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:08 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:09:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:10 user nova-compute[72184]: INFO nova.compute.manager [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Took 4.49 seconds to detach 1 volumes for instance.
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:09:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Creating image(s)
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Ensure instance console log exists: /opt/stack/data/nova/instances/5c54cfde-9fa0-4499-85f5-93c9c517f06a/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Start _get_guest_xml network_info=[{"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '67b75194-900f-4502-885d-e53e1a6ab70e', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibsZDRSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c54cfde-9fa0-4499-85f5-93c9c517f06a', 'attached_at': '', 'detached_at': '', 'volume_id': '927943e6-6eda-4ddc-ae7a-33ac0b19c3e2', 'serial': '927943e6-6eda-4ddc-ae7a-33ac0b19c3e2'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:09:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:09:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibsZDRSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:09:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:09:11 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:09:11 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29967b6a-ba35-4d68-ad06-8e70808d42f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:09:11 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaafb80-c9c1-4cc7-87e0-adc36d79aa76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2] added
Aug 01 17:09:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d097be9-49fc-47c2-970a-ba772f6da826]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac9eef-a622-4a8b-b6e8-89b57d2d0618]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibsZDRSw {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibsZDRSw" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09286342-20f7-4e83-b8d9-be32fe0a9fe3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ibsZDRSw'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef21f48-352e-4b78-a8bb-0a9b45f7ab0b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f88f91-0f1b-4957-adc9-04bca23e3502]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[491ae6c0-5a3e-43f9-a610-81d1fd9d89d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260]
Aug 01 17:09:11 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260] successful.
Aug 01 17:09:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62e448f-d040-4049-9582-75c40486e16c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c5cfd-1477-473e-87cb-fb4bb122969d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:09:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:11 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:09:11 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627f803-b3a1-4ed5-bf11-3d8fa74cf9e7]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:09:11 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibsZDRSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:09:11 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Deleted allocations for instance 52833ca5-abaa-44e7-90b1-3e18928101c2
Aug 01 17:09:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-cc2f4554-daa9-4b20-a62e-fe9121f1f3e8 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "52833ca5-abaa-44e7-90b1-3e18928101c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.142s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23966616638336562', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966616638336562', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1240962539',display_name='tempest-TestVolumeBootPattern-server-1240962539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1240962539',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-l0p34z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:08:52Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=5c54cfde-9fa0-4499-85f5-93c9c517f06a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.objects.instance [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c54cfde-9fa0-4499-85f5-93c9c517f06a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:09:12 user nova-compute[72184]:   <uuid>5c54cfde-9fa0-4499-85f5-93c9c517f06a</uuid>
Aug 01 17:09:12 user nova-compute[72184]:   <name>instance-00000024</name>
Aug 01 17:09:12 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:09:12 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:09:12 user nova-compute[72184]:   <metadata>
Aug 01 17:09:12 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:09:12 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:09:12 user nova-compute[72184]:       <nova:name>tempest-TestVolumeBootPattern-server-1240962539</nova:name>
Aug 01 17:09:12 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:09:11</nova:creationTime>
Aug 01 17:09:12 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:09:12 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:09:12 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:09:12 user nova-compute[72184]:       <nova:owner>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:user uuid="9ce144879b7e4638822f0d7174693575">tempest-TestVolumeBootPattern-1490009883-project-member</nova:user>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:project uuid="7cf5145289cf4667b9398df4a8266bb4">tempest-TestVolumeBootPattern-1490009883</nova:project>
Aug 01 17:09:12 user nova-compute[72184]:       </nova:owner>
Aug 01 17:09:12 user nova-compute[72184]:       <nova:ports>
Aug 01 17:09:12 user nova-compute[72184]:         <nova:port uuid="08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33">
Aug 01 17:09:12 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 17:09:12 user nova-compute[72184]:         </nova:port>
Aug 01 17:09:12 user nova-compute[72184]:       </nova:ports>
Aug 01 17:09:12 user nova-compute[72184]:     </nova:instance>
Aug 01 17:09:12 user nova-compute[72184]:   </metadata>
Aug 01 17:09:12 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:09:12 user nova-compute[72184]:     <system>
Aug 01 17:09:12 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:09:12 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:09:12 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:09:12 user nova-compute[72184]:       <entry name="serial">5c54cfde-9fa0-4499-85f5-93c9c517f06a</entry>
Aug 01 17:09:12 user nova-compute[72184]:       <entry name="uuid">5c54cfde-9fa0-4499-85f5-93c9c517f06a</entry>
Aug 01 17:09:12 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:09:12 user nova-compute[72184]:     </system>
Aug 01 17:09:12 user nova-compute[72184]:   </sysinfo>
Aug 01 17:09:12 user nova-compute[72184]:   <os>
Aug 01 17:09:12 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:09:12 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:09:12 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:09:12 user nova-compute[72184]:   </os>
Aug 01 17:09:12 user nova-compute[72184]:   <features>
Aug 01 17:09:12 user nova-compute[72184]:     <acpi/>
Aug 01 17:09:12 user nova-compute[72184]:     <apic/>
Aug 01 17:09:12 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:09:12 user nova-compute[72184]:   </features>
Aug 01 17:09:12 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:09:12 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:09:12 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:09:12 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:09:12 user nova-compute[72184]:   </clock>
Aug 01 17:09:12 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:09:12 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:09:12 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:09:12 user nova-compute[72184]:   </cpu>
Aug 01 17:09:12 user nova-compute[72184]:   <devices>
Aug 01 17:09:12 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:09:12 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:09:12 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:09:12 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:09:12 user nova-compute[72184]:       <serial>927943e6-6eda-4ddc-ae7a-33ac0b19c3e2</serial>
Aug 01 17:09:12 user nova-compute[72184]:     </disk>
Aug 01 17:09:12 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:09:12 user nova-compute[72184]:       <mac address="fa:16:3e:7b:bd:0a"/>
Aug 01 17:09:12 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:09:12 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:09:12 user nova-compute[72184]:       <target dev="tap08bdb8b1-8a"/>
Aug 01 17:09:12 user nova-compute[72184]:     </interface>
Aug 01 17:09:12 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:09:12 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/5c54cfde-9fa0-4499-85f5-93c9c517f06a/console.log" append="off"/>
Aug 01 17:09:12 user nova-compute[72184]:     </serial>
Aug 01 17:09:12 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:09:12 user nova-compute[72184]:     <video>
Aug 01 17:09:12 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:09:12 user nova-compute[72184]:     </video>
Aug 01 17:09:12 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:09:12 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:09:12 user nova-compute[72184]:     </rng>
Aug 01 17:09:12 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:09:12 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:09:12 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:09:12 user nova-compute[72184]:     </memballoon>
Aug 01 17:09:12 user nova-compute[72184]:   </devices>
Aug 01 17:09:12 user nova-compute[72184]: </domain>
Aug 01 17:09:12 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1240962539',display_name='tempest-TestVolumeBootPattern-server-1240962539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1240962539',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-l0p34z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:08:52Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=5c54cfde-9fa0-4499-85f5-93c9c517f06a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG os_vif [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08bdb8b1-8a, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08bdb8b1-8a, col_values=(('external_ids', {'iface-id': '08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:bd:0a', 'vm-uuid': '5c54cfde-9fa0-4499-85f5-93c9c517f06a'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:12 user nova-compute[72184]: INFO os_vif [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a')
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:09:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No VIF found with MAC fa:16:3e:7b:bd:0a, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:09:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-4707729d-88e2-4ba1-8f65-0c3b51680707 req-9a806f91-de3e-487b-b114-a3f2dde6e0b0 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4707729d-88e2-4ba1-8f65-0c3b51680707 req-9a806f91-de3e-487b-b114-a3f2dde6e0b0 service nova] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4707729d-88e2-4ba1-8f65-0c3b51680707 req-9a806f91-de3e-487b-b114-a3f2dde6e0b0 service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4707729d-88e2-4ba1-8f65-0c3b51680707 req-9a806f91-de3e-487b-b114-a3f2dde6e0b0 service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-4707729d-88e2-4ba1-8f65-0c3b51680707 req-9a806f91-de3e-487b-b114-a3f2dde6e0b0 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] No waiting events found dispatching network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:14 user nova-compute[72184]: WARNING nova.compute.manager [req-4707729d-88e2-4ba1-8f65-0c3b51680707 req-9a806f91-de3e-487b-b114-a3f2dde6e0b0 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received unexpected event network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 for instance with vm_state building and task_state spawning.
Aug 01 17:09:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:15 user nova-compute[72184]: INFO nova.compute.manager [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Detaching volume 8c1d0225-ee16-49d0-a3ff-b4a14919ec2c
Aug 01 17:09:15 user nova-compute[72184]: INFO nova.virt.block_device [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Attempting to driver detach volume 8c1d0225-ee16-49d0-a3ff-b4a14919ec2c from mountpoint /dev/vdb
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Attempting to detach device vdb from instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:09:15 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:09:15 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:09:15 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:09:15 user nova-compute[72184]:   <serial>8c1d0225-ee16-49d0-a3ff-b4a14919ec2c</serial>
Aug 01 17:09:15 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:09:15 user nova-compute[72184]: </disk>
Aug 01 17:09:15 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:09:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully detached device vdb from instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 from the persistent domain config.
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:09:15 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:09:15 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:09:15 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:09:15 user nova-compute[72184]:   <serial>8c1d0225-ee16-49d0-a3ff-b4a14919ec2c</serial>
Aug 01 17:09:15 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:09:15 user nova-compute[72184]: </disk>
Aug 01 17:09:15 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690909755.7332854, 8e5746d0-f2bb-4523-9517-7c8817fd2811 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:09:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully detached device vdb from instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 from the live domain config.
Aug 01 17:09:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDsmHgFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:09:15 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfd5cfb-738c-4efe-8c0b-4fc734ed9afa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4536b28b-cd6c-487b-a016-e7ae0f89c45b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:15 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:15 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:15 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:09:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:15 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:15 user nova-compute[72184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c (non-flash)
Aug 01 17:09:15 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:09:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30277bd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5220237-59c3-4362-b88f-0449ff44cf95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d81d524-4956-434b-be5b-86f80dd8bac7]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7709ccea-e908-4984-a98a-f1207dfda9ca]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80bc8ef-e949-4805-90a3-8855266ee3eb]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada0b254-6036-4e9f-a88d-fc5477c2cd22]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc47b2bb-f09b-46d2-b4c2-8b87f1e1858b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260]
Aug 01 17:09:15 user nova-compute[72184]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c, portal: 172.16.0.220,3260] successful.
Aug 01 17:09:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e569249c-9c53-4057-ab76-0d4d34b9f7b5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== disconnect_volume: return (282ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909756.157025, 5c54cfde-9fa0-4499-85f5-93c9c517f06a => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] VM Resumed (Lifecycle Event)
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Instance spawned successfully.
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-46efce74-a993-4fa6-85d2-2c3452f2827c req-273c3249-7449-44b9-9e69-f1968f44d273 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-46efce74-a993-4fa6-85d2-2c3452f2827c req-273c3249-7449-44b9-9e69-f1968f44d273 service nova] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-46efce74-a993-4fa6-85d2-2c3452f2827c req-273c3249-7449-44b9-9e69-f1968f44d273 service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-46efce74-a993-4fa6-85d2-2c3452f2827c req-273c3249-7449-44b9-9e69-f1968f44d273 service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-46efce74-a993-4fa6-85d2-2c3452f2827c req-273c3249-7449-44b9-9e69-f1968f44d273 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] No waiting events found dispatching network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:16 user nova-compute[72184]: WARNING nova.compute.manager [req-46efce74-a993-4fa6-85d2-2c3452f2827c req-273c3249-7449-44b9-9e69-f1968f44d273 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received unexpected event network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 for instance with vm_state building and task_state spawning.
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909756.1601887, 5c54cfde-9fa0-4499-85f5-93c9c517f06a => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] VM Started (Lifecycle Event)
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Took 25.27 seconds to build instance.
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-725a75ed-4747-4e23-be94-30eba881f4a4 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.631s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'flavor' on Instance uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6d10726b-9139-4c1a-be19-a1fdcae8b0a5 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.563s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:16 user nova-compute[72184]: INFO nova.compute.manager [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Terminating instance
Aug 01 17:09:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Instance destroyed successfully.
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lazy-loading 'resources' on Instance uuid 8e5746d0-f2bb-4523-9517-7c8817fd2811 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-908352431',display_name='tempest-VolumesSnapshotTestJSON-instance-908352431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-908352431',id=34,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJdBAb2DGdyDFgOP9YYe1EPkZSECFRqmnRaUfccbz2+AdBUtsQPWUv+eP/CvO5tH0F1K5xvS5ly7EhEWqcYCdvI8+d6LmWODMIZeW4fhkNYK6NiN3YH+hQ45zPJfbnesw==',key_name='tempest-keypair-1580667645',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bb72853e93848b6995582327cd53b9a',ramdisk_id='',reservation_id='r-rdv0mblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-785628539',owner_user_name='tempest-VolumesSnapshotTestJSON-785628539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0c8a60b3824038802bc7bb2298988f',uuid=8e5746d0-f2bb-4523-9517-7c8817fd2811,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converting VIF {"id": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "address": "fa:16:3e:f2:32:c5", "network": {"id": "c5166335-2dc5-4c73-aaa9-412354dcd351", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1892534242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb72853e93848b6995582327cd53b9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d43cfa7-09", "ovs_interfaceid": "2d43cfa7-0928-4571-8e6c-1fd4108cb358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_vif [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d43cfa7-09, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:09:17 user nova-compute[72184]: INFO os_vif [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:32:c5,bridge_name='br-int',has_traffic_filtering=True,id=2d43cfa7-0928-4571-8e6c-1fd4108cb358,network=Network(c5166335-2dc5-4c73-aaa9-412354dcd351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d43cfa7-09')
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDsmHgFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:09:17 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1d0225-ee16-49d0-a3ff-b4a14919ec2c', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cefe78-d211-4711-96f8-8d886d3c4ce7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cac00d-6fbd-4b52-b314-a71e6c5edd8c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:17 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:17 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:09:17 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:09:17 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:09:17 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:09:17 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff84ac4c0>, {}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Disconnecting from: [] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] <== disconnect_volume: return (51ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:09:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Deleting instance files /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811_del
Aug 01 17:09:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Deletion of /opt/stack/data/nova/instances/8e5746d0-f2bb-4523-9517-7c8817fd2811_del complete
Aug 01 17:09:17 user nova-compute[72184]: INFO nova.compute.manager [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 01 17:09:17 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:09:17 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-vif-unplugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] No waiting events found dispatching network-vif-unplugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-vif-unplugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] Acquiring lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] No waiting events found dispatching network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:18 user nova-compute[72184]: WARNING nova.compute.manager [req-8fd18422-205b-478f-95c4-9f4dd446f26d req-d5a79b3e-a040-42f3-b807-2d28730774d4 service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received unexpected event network-vif-plugged-2d43cfa7-0928-4571-8e6c-1fd4108cb358 for instance with vm_state active and task_state deleting.
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:19 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Took 1.30 seconds to deallocate network for instance.
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ad48462-4a21-461f-a290-acd348c60872 req-d012336c-dbb5-4aea-a8a8-502d37826a9c service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Received event network-vif-deleted-2d43cfa7-0928-4571-8e6c-1fd4108cb358 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:19 user nova-compute[72184]: INFO nova.compute.manager [req-3ad48462-4a21-461f-a290-acd348c60872 req-d012336c-dbb5-4aea-a8a8-502d37826a9c service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Neutron deleted interface 2d43cfa7-0928-4571-8e6c-1fd4108cb358; detaching it from the instance and deleting it from the info cache
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-3ad48462-4a21-461f-a290-acd348c60872 req-d012336c-dbb5-4aea-a8a8-502d37826a9c service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ad48462-4a21-461f-a290-acd348c60872 req-d012336c-dbb5-4aea-a8a8-502d37826a9c service nova] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Detach interface failed, port_id=2d43cfa7-0928-4571-8e6c-1fd4108cb358, reason: Instance 8e5746d0-f2bb-4523-9517-7c8817fd2811 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:09:19 user nova-compute[72184]: WARNING nova.volume.cinder [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Attachment 5146d48c-f851-427d-8cee-8b3445a7fe26 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5146d48c-f851-427d-8cee-8b3445a7fe26. (HTTP 404) (Request-ID: req-ab2df6e2-e2cb-44b5-832b-e42df7b32ea2)
Aug 01 17:09:19 user nova-compute[72184]: INFO nova.compute.manager [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Took 0.04 seconds to detach 1 volumes for instance.
Aug 01 17:09:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909744.623817, 75c3c16a-8768-4b24-8469-35b77664a71e => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:09:19 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] VM Stopped (Lifecycle Event)
Aug 01 17:09:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4b035119-a404-4558-b732-12bf6e29cea9 None None] [instance: 75c3c16a-8768-4b24-8469-35b77664a71e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:19 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Deleted allocations for instance 8e5746d0-f2bb-4523-9517-7c8817fd2811
Aug 01 17:09:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f7795be1-8ef0-428b-bc6a-8cc09bc6b792 tempest-VolumesSnapshotTestJSON-785628539 tempest-VolumesSnapshotTestJSON-785628539-project-member] Lock "8e5746d0-f2bb-4523-9517-7c8817fd2811" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.890s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:20 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909745.3087401, 52833ca5-abaa-44e7-90b1-3e18928101c2 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:09:20 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] VM Stopped (Lifecycle Event)
Aug 01 17:09:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7c7f3f15-781c-4a44-8bf3-6b79d8bdfbc8 None None] [instance: 52833ca5-abaa-44e7-90b1-3e18928101c2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:32 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909757.7499437, 8e5746d0-f2bb-4523-9517-7c8817fd2811 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:09:32 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] VM Stopped (Lifecycle Event)
Aug 01 17:09:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d38db6c7-7918-4af0-a5c1-e0cb8052d6c0 None None] [instance: 8e5746d0-f2bb-4523-9517-7c8817fd2811] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:09:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:55 user nova-compute[72184]: INFO nova.compute.manager [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Terminating instance
Aug 01 17:09:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-dece0d1c-f805-4f08-b8f4-0d3b7e3c8ac2 req-f9deac1e-d6c2-4331-a5fe-035b1170239e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-unplugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dece0d1c-f805-4f08-b8f4-0d3b7e3c8ac2 req-f9deac1e-d6c2-4331-a5fe-035b1170239e service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dece0d1c-f805-4f08-b8f4-0d3b7e3c8ac2 req-f9deac1e-d6c2-4331-a5fe-035b1170239e service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dece0d1c-f805-4f08-b8f4-0d3b7e3c8ac2 req-f9deac1e-d6c2-4331-a5fe-035b1170239e service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-dece0d1c-f805-4f08-b8f4-0d3b7e3c8ac2 req-f9deac1e-d6c2-4331-a5fe-035b1170239e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-unplugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-dece0d1c-f805-4f08-b8f4-0d3b7e3c8ac2 req-f9deac1e-d6c2-4331-a5fe-035b1170239e service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-unplugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Instance destroyed successfully.
Aug 01 17:09:56 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'resources' on Instance uuid 1ebe63cb-0db0-4cbf-b58b-71d07905c37d {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-966088639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-966088639',id=25,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-5bnj5r4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:02:27Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=1ebe63cb-0db0-4cbf-b58b-71d07905c37d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "a46cd6b9-962b-4a46-8812-3988e710a000", "address": "fa:16:3e:5a:5b:91", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46cd6b9-96", "ovs_interfaceid": "a46cd6b9-962b-4a46-8812-3988e710a000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG os_vif [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa46cd6b9-96, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: INFO os_vif [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5b:91,bridge_name='br-int',has_traffic_filtering=True,id=a46cd6b9-962b-4a46-8812-3988e710a000,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46cd6b9-96')
Aug 01 17:09:56 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Deleting instance files /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d_del
Aug 01 17:09:56 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Deletion of /opt/stack/data/nova/instances/1ebe63cb-0db0-4cbf-b58b-71d07905c37d_del complete
Aug 01 17:09:56 user nova-compute[72184]: INFO nova.compute.manager [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 01 17:09:56 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:57 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:58 user nova-compute[72184]: WARNING nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received unexpected event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with vm_state active and task_state deleting.
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:58 user nova-compute[72184]: WARNING nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received unexpected event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with vm_state active and task_state deleting.
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:58 user nova-compute[72184]: WARNING nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received unexpected event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with vm_state active and task_state deleting.
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-unplugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-unplugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-unplugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Acquiring lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] No waiting events found dispatching network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:09:58 user nova-compute[72184]: WARNING nova.compute.manager [req-95fb7543-795b-4bb9-a66d-a25b3710a50e req-af04b5f0-09c0-4597-8c5a-d07bdbb95ea5 service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received unexpected event network-vif-plugged-a46cd6b9-962b-4a46-8812-3988e710a000 for instance with vm_state active and task_state deleting.
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:09:58 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Took 1.74 seconds to deallocate network for instance.
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-d157b707-ba3e-45ee-9b61-77a23a96e82a req-8c183738-ddcb-48d0-a394-3d0f5002255b service nova] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Received event network-vif-deleted-a46cd6b9-962b-4a46-8812-3988e710a000 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:58 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Deleted allocations for instance 1ebe63cb-0db0-4cbf-b58b-71d07905c37d
Aug 01 17:09:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c1f5f9a9-777c-4907-a799-355d0dfb29cf tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "1ebe63cb-0db0-4cbf-b58b-71d07905c37d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.237s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:09:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:01 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:10:01 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=7982MB free_disk=25.254257202148438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Applying migration context for instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e as it has an incoming, in-progress migration c9229a4b-44d9-43a8-aa5d-ca20822827b8. Migration status is finished {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 17:10:01 user nova-compute[72184]: INFO nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating resource usage from migration c9229a4b-44d9-43a8-aa5d-ca20822827b8
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Migration c9229a4b-44d9-43a8-aa5d-ca20822827b8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5c54cfde-9fa0-4499-85f5-93c9c517f06a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:10:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:10:02 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:10:02 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:10:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:10:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:10:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:10:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:10:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:10:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [{"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-69c7aebb-9797-4347-8f0c-ce5c175629e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:10:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:10:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Going to confirm migration 2 {{(pid=72184) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'info_cache' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:10:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'migration_context' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:10 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:10:10 user nova-compute[72184]: INFO nova.compute.claims [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Claim successful on node user
Aug 01 17:10:10 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Deleted allocation for migration c9229a4b-44d9-43a8-aa5d-ca20822827b8
Aug 01 17:10:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c2a0ba42-3fb2-4ee4-82b4-bb1b4b90bef5 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.363s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909796.1051402, 1ebe63cb-0db0-4cbf-b58b-71d07905c37d => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:10:11 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] VM Stopped (Lifecycle Event)
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5df0d6f6-e391-42eb-9c9a-d879dd628e66 None None] [instance: 1ebe63cb-0db0-4cbf-b58b-71d07905c37d] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:10:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.policy [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5af08a5f7d46bdb7512360bcae3905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88373a3db0cb453b99f922d0a1a31781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:10:11 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Creating image(s)
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk 1073741824" returned: 0 in 0.067s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Cannot resize image /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'migration_context' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Ensure instance console log exists: /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Successfully created port: 445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Successfully updated port: 445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-changed-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Refreshing instance network info cache due to event network-changed-445659c5-5542-4629-9a26-80aca641662f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:10:12 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance network_info: |[{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.neutron [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Refreshing network info cache for port 445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start _get_guest_xml network_info=[{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:10:13 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:10:13 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'pci_devices' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:10:13 user nova-compute[72184]:   <uuid>48948157-6480-4c91-935d-37cd84a8b12c</uuid>
Aug 01 17:10:13 user nova-compute[72184]:   <name>instance-00000025</name>
Aug 01 17:10:13 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:10:13 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:10:13 user nova-compute[72184]:   <metadata>
Aug 01 17:10:13 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:10:13 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:10:13 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeTestJSON-server-168633703</nova:name>
Aug 01 17:10:13 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:10:13</nova:creationTime>
Aug 01 17:10:13 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:10:13 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:10:13 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:10:13 user nova-compute[72184]:       <nova:owner>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:user uuid="6a5af08a5f7d46bdb7512360bcae3905">tempest-AttachVolumeTestJSON-984518084-project-member</nova:user>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:project uuid="88373a3db0cb453b99f922d0a1a31781">tempest-AttachVolumeTestJSON-984518084</nova:project>
Aug 01 17:10:13 user nova-compute[72184]:       </nova:owner>
Aug 01 17:10:13 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:10:13 user nova-compute[72184]:       <nova:ports>
Aug 01 17:10:13 user nova-compute[72184]:         <nova:port uuid="445659c5-5542-4629-9a26-80aca641662f">
Aug 01 17:10:13 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 17:10:13 user nova-compute[72184]:         </nova:port>
Aug 01 17:10:13 user nova-compute[72184]:       </nova:ports>
Aug 01 17:10:13 user nova-compute[72184]:     </nova:instance>
Aug 01 17:10:13 user nova-compute[72184]:   </metadata>
Aug 01 17:10:13 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:10:13 user nova-compute[72184]:     <system>
Aug 01 17:10:13 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:10:13 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:10:13 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:10:13 user nova-compute[72184]:       <entry name="serial">48948157-6480-4c91-935d-37cd84a8b12c</entry>
Aug 01 17:10:13 user nova-compute[72184]:       <entry name="uuid">48948157-6480-4c91-935d-37cd84a8b12c</entry>
Aug 01 17:10:13 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:10:13 user nova-compute[72184]:     </system>
Aug 01 17:10:13 user nova-compute[72184]:   </sysinfo>
Aug 01 17:10:13 user nova-compute[72184]:   <os>
Aug 01 17:10:13 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:10:13 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:10:13 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:10:13 user nova-compute[72184]:   </os>
Aug 01 17:10:13 user nova-compute[72184]:   <features>
Aug 01 17:10:13 user nova-compute[72184]:     <acpi/>
Aug 01 17:10:13 user nova-compute[72184]:     <apic/>
Aug 01 17:10:13 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:10:13 user nova-compute[72184]:   </features>
Aug 01 17:10:13 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:10:13 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:10:13 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:10:13 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:10:13 user nova-compute[72184]:   </clock>
Aug 01 17:10:13 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:10:13 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:10:13 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:10:13 user nova-compute[72184]:   </cpu>
Aug 01 17:10:13 user nova-compute[72184]:   <devices>
Aug 01 17:10:13 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:10:13 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:10:13 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk"/>
Aug 01 17:10:13 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:10:13 user nova-compute[72184]:     </disk>
Aug 01 17:10:13 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:10:13 user nova-compute[72184]:       <mac address="fa:16:3e:4f:48:93"/>
Aug 01 17:10:13 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:10:13 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:10:13 user nova-compute[72184]:       <target dev="tap445659c5-55"/>
Aug 01 17:10:13 user nova-compute[72184]:     </interface>
Aug 01 17:10:13 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:10:13 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/console.log" append="off"/>
Aug 01 17:10:13 user nova-compute[72184]:     </serial>
Aug 01 17:10:13 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:10:13 user nova-compute[72184]:     <video>
Aug 01 17:10:13 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:10:13 user nova-compute[72184]:     </video>
Aug 01 17:10:13 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:10:13 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:10:13 user nova-compute[72184]:     </rng>
Aug 01 17:10:13 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:10:13 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:10:13 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:10:13 user nova-compute[72184]:     </memballoon>
Aug 01 17:10:13 user nova-compute[72184]:   </devices>
Aug 01 17:10:13 user nova-compute[72184]: </domain>
Aug 01 17:10:13 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG os_vif [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap445659c5-55, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap445659c5-55, col_values=(('external_ids', {'iface-id': '445659c5-5542-4629-9a26-80aca641662f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:48:93', 'vm-uuid': '48948157-6480-4c91-935d-37cd84a8b12c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:13 user nova-compute[72184]: INFO os_vif [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55')
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No VIF found with MAC fa:16:3e:4f:48:93, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.neutron [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updated VIF entry in instance network info cache for port 445659c5-5542-4629-9a26-80aca641662f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG nova.network.neutron [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-dd92271c-afd4-4737-936c-5126652011a2 req-cb7950b4-f957-4278-b71f-4af8ed616538 service nova] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-016fa0d0-3c5c-4b12-b8cb-11f20e1a23de req-2680d5fc-f0a6-49b8-85d6-8f80f779287e service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-016fa0d0-3c5c-4b12-b8cb-11f20e1a23de req-2680d5fc-f0a6-49b8-85d6-8f80f779287e service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-016fa0d0-3c5c-4b12-b8cb-11f20e1a23de req-2680d5fc-f0a6-49b8-85d6-8f80f779287e service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-016fa0d0-3c5c-4b12-b8cb-11f20e1a23de req-2680d5fc-f0a6-49b8-85d6-8f80f779287e service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-016fa0d0-3c5c-4b12-b8cb-11f20e1a23de req-2680d5fc-f0a6-49b8-85d6-8f80f779287e service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:14 user nova-compute[72184]: WARNING nova.compute.manager [req-016fa0d0-3c5c-4b12-b8cb-11f20e1a23de req-2680d5fc-f0a6-49b8-85d6-8f80f779287e service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state building and task_state spawning.
Aug 01 17:10:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909816.836774, 48948157-6480-4c91-935d-37cd84a8b12c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:10:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Resumed (Lifecycle Event)
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:10:16 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance spawned successfully.
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:10:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909816.8409383, 48948157-6480-4c91-935d-37cd84a8b12c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:10:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Started (Lifecycle Event)
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:10:16 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:10:16 user nova-compute[72184]: INFO nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-18e40335-fa73-4688-bebe-a514b40fd385 req-8ae78667-0bb2-48ca-93e8-2fff297e6760 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18e40335-fa73-4688-bebe-a514b40fd385 req-8ae78667-0bb2-48ca-93e8-2fff297e6760 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18e40335-fa73-4688-bebe-a514b40fd385 req-8ae78667-0bb2-48ca-93e8-2fff297e6760 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-18e40335-fa73-4688-bebe-a514b40fd385 req-8ae78667-0bb2-48ca-93e8-2fff297e6760 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-18e40335-fa73-4688-bebe-a514b40fd385 req-8ae78667-0bb2-48ca-93e8-2fff297e6760 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:16 user nova-compute[72184]: WARNING nova.compute.manager [req-18e40335-fa73-4688-bebe-a514b40fd385 req-8ae78667-0bb2-48ca-93e8-2fff297e6760 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state building and task_state spawning.
Aug 01 17:10:17 user nova-compute[72184]: INFO nova.compute.manager [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Took 6.31 seconds to build instance.
Aug 01 17:10:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0ec2dff8-274d-49d1-b0ae-2320905e6cdc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.409s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:19 user nova-compute[72184]: INFO nova.compute.manager [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Terminating instance
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Instance destroyed successfully.
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lazy-loading 'resources' on Instance uuid 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-661178526',display_name='tempest-VolumesNegativeTest-instance-661178526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-661178526',id=35,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bb89d5efe3f4ff0987f9b10903a0c7c',ramdisk_id='',reservation_id='r-f078ejo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-439547468',owner_user_name='tempest-VolumesNegativeTest-439547468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:08:36Z,user_data=None,user_id='9eb59567b76e4f62ac8e1249731ec8d6',uuid=3a1b3c88-6f25-4cfe-b652-c45b6b409e22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Converting VIF {"id": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "address": "fa:16:3e:4d:2b:06", "network": {"id": "579c4aaa-588c-4cb9-a0c2-f4195a6b03e7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e6b7a4186dbd44e59c7f59cf41ff19b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35d4df1-58", "ovs_interfaceid": "b35d4df1-582e-4d57-9725-4e7ef53e140e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG os_vif [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb35d4df1-58, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:10:19 user nova-compute[72184]: INFO os_vif [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2b:06,bridge_name='br-int',has_traffic_filtering=True,id=b35d4df1-582e-4d57-9725-4e7ef53e140e,network=Network(579c4aaa-588c-4cb9-a0c2-f4195a6b03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35d4df1-58')
Aug 01 17:10:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Deleting instance files /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22_del
Aug 01 17:10:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Deletion of /opt/stack/data/nova/instances/3a1b3c88-6f25-4cfe-b652-c45b6b409e22_del complete
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-db82c27e-2255-469d-9fba-4a13274ce03b req-9521518e-1490-4ad8-8032-45b0f67c0a09 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-vif-unplugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db82c27e-2255-469d-9fba-4a13274ce03b req-9521518e-1490-4ad8-8032-45b0f67c0a09 service nova] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db82c27e-2255-469d-9fba-4a13274ce03b req-9521518e-1490-4ad8-8032-45b0f67c0a09 service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db82c27e-2255-469d-9fba-4a13274ce03b req-9521518e-1490-4ad8-8032-45b0f67c0a09 service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-db82c27e-2255-469d-9fba-4a13274ce03b req-9521518e-1490-4ad8-8032-45b0f67c0a09 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] No waiting events found dispatching network-vif-unplugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-db82c27e-2255-469d-9fba-4a13274ce03b req-9521518e-1490-4ad8-8032-45b0f67c0a09 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-vif-unplugged-b35d4df1-582e-4d57-9725-4e7ef53e140e for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:10:19 user nova-compute[72184]: INFO nova.compute.manager [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 01 17:10:19 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:10:19 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:10:20 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:20 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Took 0.71 seconds to deallocate network for instance.
Aug 01 17:10:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-3c931e1f-a868-4f0e-82f2-2cbb0b5701f4 req-f0be9134-c17b-491a-b597-a21715b84ac5 service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-vif-deleted-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:10:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:10:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:20 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Deleted allocations for instance 3a1b3c88-6f25-4cfe-b652-c45b6b409e22
Aug 01 17:10:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f9b00be2-3a07-4cc9-9517-c91b6ec481b2 tempest-VolumesNegativeTest-439547468 tempest-VolumesNegativeTest-439547468-project-member] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-2551928a-f702-4ba3-b114-9e141c35f612 req-a44dd7d5-72b1-4487-9d9a-f63bf11e0a9c service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received event network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2551928a-f702-4ba3-b114-9e141c35f612 req-a44dd7d5-72b1-4487-9d9a-f63bf11e0a9c service nova] Acquiring lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2551928a-f702-4ba3-b114-9e141c35f612 req-a44dd7d5-72b1-4487-9d9a-f63bf11e0a9c service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2551928a-f702-4ba3-b114-9e141c35f612 req-a44dd7d5-72b1-4487-9d9a-f63bf11e0a9c service nova] Lock "3a1b3c88-6f25-4cfe-b652-c45b6b409e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-2551928a-f702-4ba3-b114-9e141c35f612 req-a44dd7d5-72b1-4487-9d9a-f63bf11e0a9c service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] No waiting events found dispatching network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:21 user nova-compute[72184]: WARNING nova.compute.manager [req-2551928a-f702-4ba3-b114-9e141c35f612 req-a44dd7d5-72b1-4487-9d9a-f63bf11e0a9c service nova] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Received unexpected event network-vif-plugged-b35d4df1-582e-4d57-9725-4e7ef53e140e for instance with vm_state deleted and task_state None.
Aug 01 17:10:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:34 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909819.683392, 3a1b3c88-6f25-4cfe-b652-c45b6b409e22 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:10:34 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] VM Stopped (Lifecycle Event)
Aug 01 17:10:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d20c2c37-a67e-4c6b-827c-020e102fa1df None None] [instance: 3a1b3c88-6f25-4cfe-b652-c45b6b409e22] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:10:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:41 user nova-compute[72184]: INFO nova.compute.manager [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Terminating instance
Aug 01 17:10:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-3895bc0a-55e3-4d56-af54-c9999b7e7335 req-dc61828c-2139-475d-a563-f012a6b83968 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-vif-unplugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3895bc0a-55e3-4d56-af54-c9999b7e7335 req-dc61828c-2139-475d-a563-f012a6b83968 service nova] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3895bc0a-55e3-4d56-af54-c9999b7e7335 req-dc61828c-2139-475d-a563-f012a6b83968 service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3895bc0a-55e3-4d56-af54-c9999b7e7335 req-dc61828c-2139-475d-a563-f012a6b83968 service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-3895bc0a-55e3-4d56-af54-c9999b7e7335 req-dc61828c-2139-475d-a563-f012a6b83968 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] No waiting events found dispatching network-vif-unplugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-3895bc0a-55e3-4d56-af54-c9999b7e7335 req-dc61828c-2139-475d-a563-f012a6b83968 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-vif-unplugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:10:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Instance destroyed successfully.
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'resources' on Instance uuid 5c54cfde-9fa0-4499-85f5-93c9c517f06a {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1240962539',display_name='tempest-TestVolumeBootPattern-server-1240962539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1240962539',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:09:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-l0p34z6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:09:16Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=5c54cfde-9fa0-4499-85f5-93c9c517f06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "address": "fa:16:3e:7b:bd:0a", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08bdb8b1-8a", "ovs_interfaceid": "08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_vif [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08bdb8b1-8a, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:10:42 user nova-compute[72184]: INFO os_vif [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bd:0a,bridge_name='br-int',has_traffic_filtering=True,id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08bdb8b1-8a')
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibsZDRSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:10:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4662bd0a-8426-472f-a5f5-848b29eb8f45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f2046-a2f4-4ef9-9a84-d24895302cf4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:10:42 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:10:42 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:10:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:10:42 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:10:42 user nova-compute[72184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 (non-flash)
Aug 01 17:10:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301813e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9623d5fe-bb26-47c6-a107-bbca2f7c2c5b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46f3ea-e1ce-4b82-974a-97d43c1e5249]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ec8870-ad17-4082-aa2b-0ecb2a461283]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af349d-340d-4bd1-8bc8-7219e3971a34]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23966616638336562', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e107335', '/dev/disk/by-id/scsi-1SCST_BIO4e107335-9faf83eb6dc4d0a4') {{(pid=83397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00917e64-3883-4a2d-8f95-8097ec540e24]: (4, None) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0babf59d-acc1-4250-9972-e0853074bac9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f93cad-aade-44ed-b814-6bd121f37cfc]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260]
Aug 01 17:10:42 user nova-compute[72184]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2, portal: 172.16.0.220,3260] successful.
Aug 01 17:10:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9bf7e-0d60-407e-9284-d353e6806046]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== disconnect_volume: return (307ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:10:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Deleting instance files /opt/stack/data/nova/instances/5c54cfde-9fa0-4499-85f5-93c9c517f06a_del
Aug 01 17:10:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Deletion of /opt/stack/data/nova/instances/5c54cfde-9fa0-4499-85f5-93c9c517f06a_del complete
Aug 01 17:10:42 user nova-compute[72184]: INFO nova.compute.manager [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 01 17:10:42 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:10:42 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-72e10e96-ee4c-49de-8410-406f5ea775b5 req-6d8c66c6-0eb9-4eaf-8625-142592b41339 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-vif-deleted-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:43 user nova-compute[72184]: INFO nova.compute.manager [req-72e10e96-ee4c-49de-8410-406f5ea775b5 req-6d8c66c6-0eb9-4eaf-8625-142592b41339 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Neutron deleted interface 08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33; detaching it from the instance and deleting it from the info cache
Aug 01 17:10:43 user nova-compute[72184]: DEBUG nova.network.neutron [req-72e10e96-ee4c-49de-8410-406f5ea775b5 req-6d8c66c6-0eb9-4eaf-8625-142592b41339 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:43 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Took 0.98 seconds to deallocate network for instance.
Aug 01 17:10:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-72e10e96-ee4c-49de-8410-406f5ea775b5 req-6d8c66c6-0eb9-4eaf-8625-142592b41339 service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Detach interface failed, port_id=08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33, reason: Instance 5c54cfde-9fa0-4499-85f5-93c9c517f06a could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-e9c8e58a-b35c-41e6-8be3-ed2503847a84 req-eb736dd1-4acd-4628-b70e-5a6d2f5f0e4a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received event network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e9c8e58a-b35c-41e6-8be3-ed2503847a84 req-eb736dd1-4acd-4628-b70e-5a6d2f5f0e4a service nova] Acquiring lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e9c8e58a-b35c-41e6-8be3-ed2503847a84 req-eb736dd1-4acd-4628-b70e-5a6d2f5f0e4a service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e9c8e58a-b35c-41e6-8be3-ed2503847a84 req-eb736dd1-4acd-4628-b70e-5a6d2f5f0e4a service nova] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-e9c8e58a-b35c-41e6-8be3-ed2503847a84 req-eb736dd1-4acd-4628-b70e-5a6d2f5f0e4a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] No waiting events found dispatching network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:43 user nova-compute[72184]: WARNING nova.compute.manager [req-e9c8e58a-b35c-41e6-8be3-ed2503847a84 req-eb736dd1-4acd-4628-b70e-5a6d2f5f0e4a service nova] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Received unexpected event network-vif-plugged-08bdb8b1-8ae5-453e-90b5-8b4a5ecd5f33 for instance with vm_state active and task_state deleting.
Aug 01 17:10:44 user nova-compute[72184]: INFO nova.compute.manager [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Took 0.70 seconds to detach 1 volumes for instance.
Aug 01 17:10:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Deleting volume: 927943e6-6eda-4ddc-ae7a-33ac0b19c3e2 {{(pid=72184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 17:10:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:44 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:10:44 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:10:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:44 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Deleted allocations for instance 5c54cfde-9fa0-4499-85f5-93c9c517f06a
Aug 01 17:10:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0b9acbfd-faf6-499c-9a0b-faf79fa1ec91 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "5c54cfde-9fa0-4499-85f5-93c9c517f06a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.320s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:45 user nova-compute[72184]: INFO nova.compute.manager [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Terminating instance
Aug 01 17:10:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-ad1283f8-e3d4-437b-9c30-6ce7235ea115 req-bd00d6d4-363a-44d4-8a33-25ce26bfc828 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ad1283f8-e3d4-437b-9c30-6ce7235ea115 req-bd00d6d4-363a-44d4-8a33-25ce26bfc828 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ad1283f8-e3d4-437b-9c30-6ce7235ea115 req-bd00d6d4-363a-44d4-8a33-25ce26bfc828 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ad1283f8-e3d4-437b-9c30-6ce7235ea115 req-bd00d6d4-363a-44d4-8a33-25ce26bfc828 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-ad1283f8-e3d4-437b-9c30-6ce7235ea115 req-bd00d6d4-363a-44d4-8a33-25ce26bfc828 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-ad1283f8-e3d4-437b-9c30-6ce7235ea115 req-bd00d6d4-363a-44d4-8a33-25ce26bfc828 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-unplugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:10:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Instance destroyed successfully.
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.objects.instance [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'resources' on Instance uuid 69c7aebb-9797-4347-8f0c-ce5c175629e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-18467087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-18467087',id=16,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-kbqzxqu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:58:42Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=69c7aebb-9797-4347-8f0c-ce5c175629e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "address": "fa:16:3e:2a:08:cd", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb757b6-8c", "ovs_interfaceid": "0bb757b6-8cb4-4a5b-986f-3299f6cc5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_vif [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb757b6-8c, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:10:46 user nova-compute[72184]: INFO os_vif [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb757b6-8c')
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJAsRMwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:10:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a078f9-46ab-4c9d-a5ad-5c37e7919c21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba12c5-ac19-4381-9954-335136a6fc99]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:10:46 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:10:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc (non-flash)
Aug 01 17:10:46 user nova-compute[72184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:10:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc'): ({'sdi'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Removing single pathed devices sdi {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9e512e-a1d6-46bc-b7b7-72dd394d9b38]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473284e-c7ad-4eea-a07a-56bade674b00]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Flushing IO for device /dev/sdi {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97860869-688f-4b71-8438-652195825f33]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63098b7d-1277-41d6-84e7-00529e828acf]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] SCSI volumes sdi have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351c753-e8c7-43fc-b3df-84a482640b1e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be6f2d-9b7b-4443-b7c0-ed78c1825366]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260]
Aug 01 17:10:46 user nova-compute[72184]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc, portal: 172.16.0.220,3260] successful.
Aug 01 17:10:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22608d4-9439-4d52-b66b-f5d9150027dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cbc5bc-1285-43a2-90ac-3c89342a311d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] <== disconnect_volume: return (296ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:10:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:10:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Deleting instance files /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2_del
Aug 01 17:10:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Deletion of /opt/stack/data/nova/instances/69c7aebb-9797-4347-8f0c-ce5c175629e2_del complete
Aug 01 17:10:47 user nova-compute[72184]: INFO nova.compute.manager [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 17:10:47 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:10:47 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:10:47 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:10:47 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:47 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Took 0.57 seconds to deallocate network for instance.
Aug 01 17:10:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-e446fa28-edae-4c6e-9404-0da5ffe8e57f req-ad4a3e28-58c4-450f-b911-5a05f81e5cc9 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-deleted-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:47 user nova-compute[72184]: INFO nova.compute.manager [req-e446fa28-edae-4c6e-9404-0da5ffe8e57f req-ad4a3e28-58c4-450f-b911-5a05f81e5cc9 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Neutron deleted interface 0bb757b6-8cb4-4a5b-986f-3299f6cc5265; detaching it from the instance and deleting it from the info cache
Aug 01 17:10:47 user nova-compute[72184]: DEBUG nova.network.neutron [req-e446fa28-edae-4c6e-9404-0da5ffe8e57f req-ad4a3e28-58c4-450f-b911-5a05f81e5cc9 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:10:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-e446fa28-edae-4c6e-9404-0da5ffe8e57f req-ad4a3e28-58c4-450f-b911-5a05f81e5cc9 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Detach interface failed, port_id=0bb757b6-8cb4-4a5b-986f-3299f6cc5265, reason: Instance 69c7aebb-9797-4347-8f0c-ce5c175629e2 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-339f14a8-b30e-4cf5-94c9-eaecfe5383a0 req-3e763a9b-289e-4d0c-93e6-60e2fb68efa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-339f14a8-b30e-4cf5-94c9-eaecfe5383a0 req-3e763a9b-289e-4d0c-93e6-60e2fb68efa2 service nova] Acquiring lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-339f14a8-b30e-4cf5-94c9-eaecfe5383a0 req-3e763a9b-289e-4d0c-93e6-60e2fb68efa2 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-339f14a8-b30e-4cf5-94c9-eaecfe5383a0 req-3e763a9b-289e-4d0c-93e6-60e2fb68efa2 service nova] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-339f14a8-b30e-4cf5-94c9-eaecfe5383a0 req-3e763a9b-289e-4d0c-93e6-60e2fb68efa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] No waiting events found dispatching network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:10:48 user nova-compute[72184]: WARNING nova.compute.manager [req-339f14a8-b30e-4cf5-94c9-eaecfe5383a0 req-3e763a9b-289e-4d0c-93e6-60e2fb68efa2 service nova] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Received unexpected event network-vif-plugged-0bb757b6-8cb4-4a5b-986f-3299f6cc5265 for instance with vm_state active and task_state deleting.
Aug 01 17:10:48 user nova-compute[72184]: INFO nova.compute.manager [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:48 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Deleted allocations for instance 69c7aebb-9797-4347-8f0c-ce5c175629e2
Aug 01 17:10:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-261e896e-ef94-4e22-92e8-cd1153bdb216 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "69c7aebb-9797-4347-8f0c-ce5c175629e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:10:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:10:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:10:57 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909842.3081357, 5c54cfde-9fa0-4499-85f5-93c9c517f06a => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:10:57 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] VM Stopped (Lifecycle Event)
Aug 01 17:10:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5302869f-5157-46ce-940d-78a3bea358e6 None None] [instance: 5c54cfde-9fa0-4499-85f5-93c9c517f06a] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:10:58 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909846.5979052, 69c7aebb-9797-4347-8f0c-ce5c175629e2 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:11:01 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] VM Stopped (Lifecycle Event)
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a6e4e77e-3dfe-4f32-97a9-7b1ba67df3f8 None None] [instance: 69c7aebb-9797-4347-8f0c-ce5c175629e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:11:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8210MB free_disk=25.242504119873047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:11:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:11:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:11:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:11:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:11:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [{"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:11:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:11:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:11:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:11:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:11:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:11:36 user nova-compute[72184]: INFO nova.compute.claims [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Claim successful on node user
Aug 01 17:11:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:36 user nova-compute[72184]: INFO nova.compute.manager [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Terminating instance
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-0581b677-77e7-498e-95ba-2bc8f572e3cd req-d7458b57-d80c-4ba2-8c19-4b507ee5a9da service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-unplugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0581b677-77e7-498e-95ba-2bc8f572e3cd req-d7458b57-d80c-4ba2-8c19-4b507ee5a9da service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0581b677-77e7-498e-95ba-2bc8f572e3cd req-d7458b57-d80c-4ba2-8c19-4b507ee5a9da service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0581b677-77e7-498e-95ba-2bc8f572e3cd req-d7458b57-d80c-4ba2-8c19-4b507ee5a9da service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-0581b677-77e7-498e-95ba-2bc8f572e3cd req-d7458b57-d80c-4ba2-8c19-4b507ee5a9da service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-unplugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-0581b677-77e7-498e-95ba-2bc8f572e3cd req-d7458b57-d80c-4ba2-8c19-4b507ee5a9da service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-unplugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:11:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.policy [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5ba0dd45ab74761a449d968e13c3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ae30149b894335808497b67db5c5b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:11:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Creating image(s)
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "/opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "/opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Instance destroyed successfully.
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lazy-loading 'resources' on Instance uuid 76785510-2f39-4b4f-a11c-d30f9cd82138 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk 1073741824" returned: 0 in 0.100s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:51:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-382219524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-382219524',id=4,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13772bce6fa482189f819cb065170b3',ramdisk_id='',reservation_id='r-bqkkxd8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-388641611',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:53:52Z,user_data=None,user_id='1b9ae86640754099bb01c48a6807075f',uuid=76785510-2f39-4b4f-a11c-d30f9cd82138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converting VIF {"id": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "address": "fa:16:3e:56:c7:e6", "network": {"id": "0be7082e-7382-4ab7-8c8c-d5b697ff864e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-45511874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13772bce6fa482189f819cb065170b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06f6e5-8d", "ovs_interfaceid": "9b06f6e5-8d35-4eb3-9768-03cfcb58cd80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG os_vif [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b06f6e5-8d, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:37 user nova-compute[72184]: INFO os_vif [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c7:e6,bridge_name='br-int',has_traffic_filtering=True,id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80,network=Network(0be7082e-7382-4ab7-8c8c-d5b697ff864e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06f6e5-8d')
Aug 01 17:11:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Deleting instance files /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138_del
Aug 01 17:11:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Deletion of /opt/stack/data/nova/instances/76785510-2f39-4b4f-a11c-d30f9cd82138_del complete
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:37 user nova-compute[72184]: INFO nova.compute.manager [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Cannot resize image /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'migration_context' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Ensure instance console log exists: /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Successfully created port: fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:38 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Took 0.55 seconds to deallocate network for instance.
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-7559d20d-35de-4d60-94d1-e4645cf812ae req-44f68654-3241-4488-8e2d-7c3175bdbd3d service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-deleted-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:38 user nova-compute[72184]: INFO nova.compute.manager [req-7559d20d-35de-4d60-94d1-e4645cf812ae req-44f68654-3241-4488-8e2d-7c3175bdbd3d service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Neutron deleted interface 9b06f6e5-8d35-4eb3-9768-03cfcb58cd80; detaching it from the instance and deleting it from the info cache
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.network.neutron [req-7559d20d-35de-4d60-94d1-e4645cf812ae req-44f68654-3241-4488-8e2d-7c3175bdbd3d service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-7559d20d-35de-4d60-94d1-e4645cf812ae req-44f68654-3241-4488-8e2d-7c3175bdbd3d service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Detach interface failed, port_id=9b06f6e5-8d35-4eb3-9768-03cfcb58cd80, reason: Instance 76785510-2f39-4b4f-a11c-d30f9cd82138 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:38 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Deleted allocations for instance 76785510-2f39-4b4f-a11c-d30f9cd82138
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d667fe5c-f33e-41bf-bf8d-35ac30356de7 tempest-ServerBootFromVolumeStableRescueTest-388641611 tempest-ServerBootFromVolumeStableRescueTest-388641611-project-member] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Successfully updated port: fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquired lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-changed-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Refreshing instance network info cache due to event network-changed-fc0db13b-b4b3-4395-949f-90dae118b6dd. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] Acquiring lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:11:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state deleted and task_state None.
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state deleted and task_state None.
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state deleted and task_state None.
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-unplugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-unplugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-unplugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state deleted and task_state None.
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Acquiring lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] Lock "76785510-2f39-4b4f-a11c-d30f9cd82138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] No waiting events found dispatching network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.compute.manager [req-961c3e99-c845-421c-8323-93dd71c677f9 req-75a19ea5-ba9a-4cfb-81ea-d8a875ab72e5 service nova] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Received unexpected event network-vif-plugged-9b06f6e5-8d35-4eb3-9768-03cfcb58cd80 for instance with vm_state deleted and task_state None.
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating instance_info_cache with network_info: [{"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Releasing lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Instance network_info: |[{"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] Acquired lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Refreshing network info cache for port fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Start _get_guest_xml network_info=[{"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:11:39 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1394141845',display_name='tempest-TestServerVolumeAttachmentScenario-server-1394141845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1394141845',id=38,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPZzYe3pxRlftgtOv8G+wKJjPu2MM2s5IjYKrLxG+Qm9pR8/Prp5qtUAHvqC4q4tv5VsFt6/DZfszjnPQpY85IIvGBA8ShYaGT0To/R58lfBphzMT/+sO8vCsFfA0jMBg==',key_name='tempest-keypair-1167773480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4ae30149b894335808497b67db5c5b8',ramdisk_id='',reservation_id='r-50ld8xse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1259591507',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1259591507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5ba0dd45ab74761a449d968e13c3e7f',uuid=0f847a44-3dc0-42c8-bf2c-457aab2f47f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Converting VIF {"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:11:39 user nova-compute[72184]:   <uuid>0f847a44-3dc0-42c8-bf2c-457aab2f47f2</uuid>
Aug 01 17:11:39 user nova-compute[72184]:   <name>instance-00000026</name>
Aug 01 17:11:39 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:11:39 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:11:39 user nova-compute[72184]:   <metadata>
Aug 01 17:11:39 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:11:39 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:11:39 user nova-compute[72184]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1394141845</nova:name>
Aug 01 17:11:39 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:11:39</nova:creationTime>
Aug 01 17:11:39 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:11:39 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:11:39 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:11:39 user nova-compute[72184]:       <nova:owner>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:user uuid="e5ba0dd45ab74761a449d968e13c3e7f">tempest-TestServerVolumeAttachmentScenario-1259591507-project-member</nova:user>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:project uuid="e4ae30149b894335808497b67db5c5b8">tempest-TestServerVolumeAttachmentScenario-1259591507</nova:project>
Aug 01 17:11:39 user nova-compute[72184]:       </nova:owner>
Aug 01 17:11:39 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:11:39 user nova-compute[72184]:       <nova:ports>
Aug 01 17:11:39 user nova-compute[72184]:         <nova:port uuid="fc0db13b-b4b3-4395-949f-90dae118b6dd">
Aug 01 17:11:39 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 17:11:39 user nova-compute[72184]:         </nova:port>
Aug 01 17:11:39 user nova-compute[72184]:       </nova:ports>
Aug 01 17:11:39 user nova-compute[72184]:     </nova:instance>
Aug 01 17:11:39 user nova-compute[72184]:   </metadata>
Aug 01 17:11:39 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:11:39 user nova-compute[72184]:     <system>
Aug 01 17:11:39 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:11:39 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:11:39 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:11:39 user nova-compute[72184]:       <entry name="serial">0f847a44-3dc0-42c8-bf2c-457aab2f47f2</entry>
Aug 01 17:11:39 user nova-compute[72184]:       <entry name="uuid">0f847a44-3dc0-42c8-bf2c-457aab2f47f2</entry>
Aug 01 17:11:39 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:11:39 user nova-compute[72184]:     </system>
Aug 01 17:11:39 user nova-compute[72184]:   </sysinfo>
Aug 01 17:11:39 user nova-compute[72184]:   <os>
Aug 01 17:11:39 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:11:39 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:11:39 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:11:39 user nova-compute[72184]:   </os>
Aug 01 17:11:39 user nova-compute[72184]:   <features>
Aug 01 17:11:39 user nova-compute[72184]:     <acpi/>
Aug 01 17:11:39 user nova-compute[72184]:     <apic/>
Aug 01 17:11:39 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:11:39 user nova-compute[72184]:   </features>
Aug 01 17:11:39 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:11:39 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:11:39 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:11:39 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:11:39 user nova-compute[72184]:   </clock>
Aug 01 17:11:39 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:11:39 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:11:39 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:11:39 user nova-compute[72184]:   </cpu>
Aug 01 17:11:39 user nova-compute[72184]:   <devices>
Aug 01 17:11:39 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:11:39 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:11:39 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk"/>
Aug 01 17:11:39 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:11:39 user nova-compute[72184]:     </disk>
Aug 01 17:11:39 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:11:39 user nova-compute[72184]:       <mac address="fa:16:3e:f0:4c:69"/>
Aug 01 17:11:39 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:11:39 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:11:39 user nova-compute[72184]:       <target dev="tapfc0db13b-b4"/>
Aug 01 17:11:39 user nova-compute[72184]:     </interface>
Aug 01 17:11:39 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:11:39 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/console.log" append="off"/>
Aug 01 17:11:39 user nova-compute[72184]:     </serial>
Aug 01 17:11:39 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:11:39 user nova-compute[72184]:     <video>
Aug 01 17:11:39 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:11:39 user nova-compute[72184]:     </video>
Aug 01 17:11:39 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:11:39 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:11:39 user nova-compute[72184]:     </rng>
Aug 01 17:11:39 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:11:39 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:11:39 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:11:39 user nova-compute[72184]:     </memballoon>
Aug 01 17:11:39 user nova-compute[72184]:   </devices>
Aug 01 17:11:39 user nova-compute[72184]: </domain>
Aug 01 17:11:39 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1394141845',display_name='tempest-TestServerVolumeAttachmentScenario-server-1394141845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1394141845',id=38,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPZzYe3pxRlftgtOv8G+wKJjPu2MM2s5IjYKrLxG+Qm9pR8/Prp5qtUAHvqC4q4tv5VsFt6/DZfszjnPQpY85IIvGBA8ShYaGT0To/R58lfBphzMT/+sO8vCsFfA0jMBg==',key_name='tempest-keypair-1167773480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4ae30149b894335808497b67db5c5b8',ramdisk_id='',reservation_id='r-50ld8xse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1259591507',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1259591507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5ba0dd45ab74761a449d968e13c3e7f',uuid=0f847a44-3dc0-42c8-bf2c-457aab2f47f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Converting VIF {"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG os_vif [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc0db13b-b4, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc0db13b-b4, col_values=(('external_ids', {'iface-id': 'fc0db13b-b4b3-4395-949f-90dae118b6dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:4c:69', 'vm-uuid': '0f847a44-3dc0-42c8-bf2c-457aab2f47f2'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:39 user nova-compute[72184]: INFO os_vif [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4')
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No VIF found with MAC fa:16:3e:f0:4c:69, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updated VIF entry in instance network info cache for port fc0db13b-b4b3-4395-949f-90dae118b6dd. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating instance_info_cache with network_info: [{"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-61429d08-7d4e-4af3-819d-2a420454ff70 req-baf6a5e9-c35c-44cf-b8c2-d68591049f82 service nova] Releasing lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-de203249-0945-4d75-a95f-7cc0c3f4aa22 req-2b5de140-6a65-47ce-a0a6-053bea806438 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-de203249-0945-4d75-a95f-7cc0c3f4aa22 req-2b5de140-6a65-47ce-a0a6-053bea806438 service nova] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-de203249-0945-4d75-a95f-7cc0c3f4aa22 req-2b5de140-6a65-47ce-a0a6-053bea806438 service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-de203249-0945-4d75-a95f-7cc0c3f4aa22 req-2b5de140-6a65-47ce-a0a6-053bea806438 service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-de203249-0945-4d75-a95f-7cc0c3f4aa22 req-2b5de140-6a65-47ce-a0a6-053bea806438 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] No waiting events found dispatching network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:40 user nova-compute[72184]: WARNING nova.compute.manager [req-de203249-0945-4d75-a95f-7cc0c3f4aa22 req-2b5de140-6a65-47ce-a0a6-053bea806438 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received unexpected event network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd for instance with vm_state building and task_state spawning.
Aug 01 17:11:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909902.8294601, 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:11:42 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] VM Resumed (Lifecycle Event)
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:11:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Instance spawned successfully.
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:11:42 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909902.8311517, 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:11:42 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] VM Started (Lifecycle Event)
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:11:42 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:11:42 user nova-compute[72184]: INFO nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 01 17:11:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:11:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-fdb4b1f9-0f2a-4139-ad62-c9ad5dcd75c6 req-b9142374-f411-49d7-adb9-806bd3e2061f service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fdb4b1f9-0f2a-4139-ad62-c9ad5dcd75c6 req-b9142374-f411-49d7-adb9-806bd3e2061f service nova] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fdb4b1f9-0f2a-4139-ad62-c9ad5dcd75c6 req-b9142374-f411-49d7-adb9-806bd3e2061f service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fdb4b1f9-0f2a-4139-ad62-c9ad5dcd75c6 req-b9142374-f411-49d7-adb9-806bd3e2061f service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-fdb4b1f9-0f2a-4139-ad62-c9ad5dcd75c6 req-b9142374-f411-49d7-adb9-806bd3e2061f service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] No waiting events found dispatching network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:43 user nova-compute[72184]: WARNING nova.compute.manager [req-fdb4b1f9-0f2a-4139-ad62-c9ad5dcd75c6 req-b9142374-f411-49d7-adb9-806bd3e2061f service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received unexpected event network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd for instance with vm_state building and task_state spawning.
Aug 01 17:11:43 user nova-compute[72184]: INFO nova.compute.manager [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Took 6.44 seconds to build instance.
Aug 01 17:11:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-bce72a5d-3245-42c0-ace2-37d4f96235e6 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.868s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:11:48 user nova-compute[72184]: INFO nova.compute.claims [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Claim successful on node user
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:11:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:11:48 user nova-compute[72184]: INFO nova.virt.block_device [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Booting with volume 026ac40b-af20-451b-ba01-87cac3bcf75e at /dev/vda
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.policy [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce144879b7e4638822f0d7174693575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf5145289cf4667b9398df4a8266bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG os_brick.utils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6284d6c-de56-474c-a6db-ac6c37eb18b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2e62c5-5750-496d-96bf-939ebdfc0410]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7eca26-be09-4d92-b0be-e82b7aa51247]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ed0e6-5d41-4a34-a205-e79ee2584a32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:11:48 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:11:48 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc3e88-8edb-44b0-b3c4-a86b7288c642]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG os_brick.utils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:11:48 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updating existing volume attachment record: 9ff81cf9-7fb2-4215-ac89-c3dfbc827374 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:11:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Successfully created port: f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:11:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Successfully updated port: f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquired lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-changed-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Refreshing instance network info cache due to event network-changed-f6caefbf-2287-407b-bf3f-8e6e401e709f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:11:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] Acquiring lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updating instance_info_cache with network_info: [{"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Releasing lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Instance network_info: |[{"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] Acquired lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Refreshing network info cache for port f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updated VIF entry in instance network info cache for port f6caefbf-2287-407b-bf3f-8e6e401e709f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updating instance_info_cache with network_info: [{"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:11:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2d778ddd-d171-4def-aa06-a19565f4c9f4 req-30cede59-531c-49f4-82b1-32cb956b7c59 service nova] Releasing lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:11:52 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909897.4884062, 76785510-2f39-4b4f-a11c-d30f9cd82138 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:11:52 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] VM Stopped (Lifecycle Event)
Aug 01 17:11:52 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2a5b7242-fe1c-409a-81bd-e3ea6d2a4d73 None None] [instance: 76785510-2f39-4b4f-a11c-d30f9cd82138] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:11:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:11:56 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Creating image(s)
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Ensure instance console log exists: /opt/stack/data/nova/instances/0b618734-f7e5-4faf-96c8-43b4d8a45a13/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Start _get_guest_xml network_info=[{"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '9ff81cf9-7fb2-4215-ac89-c3dfbc827374', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDIwGKVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0b618734-f7e5-4faf-96c8-43b4d8a45a13', 'attached_at': '', 'detached_at': '', 'volume_id': '026ac40b-af20-451b-ba01-87cac3bcf75e', 'serial': '026ac40b-af20-451b-ba01-87cac3bcf75e'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:11:56 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:11:56 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDIwGKVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:11:56 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:11:56 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:11:56 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06220456-1049-41c6-8295-5788331468ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:11:56 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47082e4d-0bc8-42b6-aabc-a4f903dfab75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e] added
Aug 01 17:11:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90efa6d-8a49-4786-8c37-3710446f1a72]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fcdc5f-0bf0-4a46-9e03-e9d10fb0618f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDIwGKVy {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDIwGKVy" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd6179-f348-42c9-88e5-f7d22315dcfc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDIwGKVy'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bebaec-3665-433e-8105-0db6d0a62eb4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae721a-5f48-4aaf-b511-fb9514331c19]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:11:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:11:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3f4818-6478-4c46-ba05-6626ecc2477a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260]
Aug 01 17:11:56 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260] successful.
Aug 01 17:11:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9a83b8-acd1-4f76-afdd-97ef2b4246dd]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a3f680-a807-4e87-9890-9d1ef3deaf1c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:11:56 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:11:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:11:56 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:11:56 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ca9e4a-d87d-498d-b44f-5202da3fcc72]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:11:56 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDIwGKVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26334616532346333', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334616532346333', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-162498531',display_name='tempest-TestVolumeBootPattern-volume-backed-server-162498531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-162498531',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAurSUqiHpftaSRhXnMtQii5p+WblvMC3XbNBx3nzCB5+KFTZbwBhaMfuSOKwR4vqe0Cc0/xq/ymz/a1bE+23U2DtQL70e9fYyyz+7+cLVZKDSFnwBcdAw1Bwdx1ubjuEg==',key_name='tempest-keypair-705488717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-nf901oa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce144879b7e4638822f0d7174693575',uuid=0b618734-f7e5-4faf-96c8-43b4d8a45a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b618734-f7e5-4faf-96c8-43b4d8a45a13 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:11:57 user nova-compute[72184]:   <uuid>0b618734-f7e5-4faf-96c8-43b4d8a45a13</uuid>
Aug 01 17:11:57 user nova-compute[72184]:   <name>instance-00000027</name>
Aug 01 17:11:57 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:11:57 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:11:57 user nova-compute[72184]:   <metadata>
Aug 01 17:11:57 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:11:57 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:11:57 user nova-compute[72184]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-162498531</nova:name>
Aug 01 17:11:57 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:11:56</nova:creationTime>
Aug 01 17:11:57 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:11:57 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:11:57 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:11:57 user nova-compute[72184]:       <nova:owner>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:user uuid="9ce144879b7e4638822f0d7174693575">tempest-TestVolumeBootPattern-1490009883-project-member</nova:user>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:project uuid="7cf5145289cf4667b9398df4a8266bb4">tempest-TestVolumeBootPattern-1490009883</nova:project>
Aug 01 17:11:57 user nova-compute[72184]:       </nova:owner>
Aug 01 17:11:57 user nova-compute[72184]:       <nova:ports>
Aug 01 17:11:57 user nova-compute[72184]:         <nova:port uuid="f6caefbf-2287-407b-bf3f-8e6e401e709f">
Aug 01 17:11:57 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 17:11:57 user nova-compute[72184]:         </nova:port>
Aug 01 17:11:57 user nova-compute[72184]:       </nova:ports>
Aug 01 17:11:57 user nova-compute[72184]:     </nova:instance>
Aug 01 17:11:57 user nova-compute[72184]:   </metadata>
Aug 01 17:11:57 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:11:57 user nova-compute[72184]:     <system>
Aug 01 17:11:57 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:11:57 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:11:57 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:11:57 user nova-compute[72184]:       <entry name="serial">0b618734-f7e5-4faf-96c8-43b4d8a45a13</entry>
Aug 01 17:11:57 user nova-compute[72184]:       <entry name="uuid">0b618734-f7e5-4faf-96c8-43b4d8a45a13</entry>
Aug 01 17:11:57 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:11:57 user nova-compute[72184]:     </system>
Aug 01 17:11:57 user nova-compute[72184]:   </sysinfo>
Aug 01 17:11:57 user nova-compute[72184]:   <os>
Aug 01 17:11:57 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:11:57 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:11:57 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:11:57 user nova-compute[72184]:   </os>
Aug 01 17:11:57 user nova-compute[72184]:   <features>
Aug 01 17:11:57 user nova-compute[72184]:     <acpi/>
Aug 01 17:11:57 user nova-compute[72184]:     <apic/>
Aug 01 17:11:57 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:11:57 user nova-compute[72184]:   </features>
Aug 01 17:11:57 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:11:57 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:11:57 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:11:57 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:11:57 user nova-compute[72184]:   </clock>
Aug 01 17:11:57 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:11:57 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:11:57 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:11:57 user nova-compute[72184]:   </cpu>
Aug 01 17:11:57 user nova-compute[72184]:   <devices>
Aug 01 17:11:57 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:11:57 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:11:57 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:11:57 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:11:57 user nova-compute[72184]:       <serial>026ac40b-af20-451b-ba01-87cac3bcf75e</serial>
Aug 01 17:11:57 user nova-compute[72184]:     </disk>
Aug 01 17:11:57 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:11:57 user nova-compute[72184]:       <mac address="fa:16:3e:1f:d0:cd"/>
Aug 01 17:11:57 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:11:57 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:11:57 user nova-compute[72184]:       <target dev="tapf6caefbf-22"/>
Aug 01 17:11:57 user nova-compute[72184]:     </interface>
Aug 01 17:11:57 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:11:57 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/0b618734-f7e5-4faf-96c8-43b4d8a45a13/console.log" append="off"/>
Aug 01 17:11:57 user nova-compute[72184]:     </serial>
Aug 01 17:11:57 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:11:57 user nova-compute[72184]:     <video>
Aug 01 17:11:57 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:11:57 user nova-compute[72184]:     </video>
Aug 01 17:11:57 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:11:57 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:11:57 user nova-compute[72184]:     </rng>
Aug 01 17:11:57 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:11:57 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:11:57 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:11:57 user nova-compute[72184]:     </memballoon>
Aug 01 17:11:57 user nova-compute[72184]:   </devices>
Aug 01 17:11:57 user nova-compute[72184]: </domain>
Aug 01 17:11:57 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-162498531',display_name='tempest-TestVolumeBootPattern-volume-backed-server-162498531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-162498531',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAurSUqiHpftaSRhXnMtQii5p+WblvMC3XbNBx3nzCB5+KFTZbwBhaMfuSOKwR4vqe0Cc0/xq/ymz/a1bE+23U2DtQL70e9fYyyz+7+cLVZKDSFnwBcdAw1Bwdx1ubjuEg==',key_name='tempest-keypair-705488717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-nf901oa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce144879b7e4638822f0d7174693575',uuid=0b618734-f7e5-4faf-96c8-43b4d8a45a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG os_vif [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6caefbf-22, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6caefbf-22, col_values=(('external_ids', {'iface-id': 'f6caefbf-2287-407b-bf3f-8e6e401e709f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:d0:cd', 'vm-uuid': '0b618734-f7e5-4faf-96c8-43b4d8a45a13'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:57 user nova-compute[72184]: INFO os_vif [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22')
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:11:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No VIF found with MAC fa:16:3e:1f:d0:cd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:11:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-06b1b42a-820d-480c-966f-642ada8acade req-357711cd-e2be-4895-ae70-9279271b7db3 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-06b1b42a-820d-480c-966f-642ada8acade req-357711cd-e2be-4895-ae70-9279271b7db3 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-06b1b42a-820d-480c-966f-642ada8acade req-357711cd-e2be-4895-ae70-9279271b7db3 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-06b1b42a-820d-480c-966f-642ada8acade req-357711cd-e2be-4895-ae70-9279271b7db3 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-06b1b42a-820d-480c-966f-642ada8acade req-357711cd-e2be-4895-ae70-9279271b7db3 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:11:59 user nova-compute[72184]: WARNING nova.compute.manager [req-06b1b42a-820d-480c-966f-642ada8acade req-357711cd-e2be-4895-ae70-9279271b7db3 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received unexpected event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with vm_state building and task_state spawning.
Aug 01 17:11:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:11:59 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:00 user nova-compute[72184]: INFO nova.compute.manager [None req-0317e48c-26db-47e6-aaac-2dd2b82177fd tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Get console output
Aug 01 17:12:00 user nova-compute[72184]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 17:12:00 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909921.025765, 0b618734-f7e5-4faf-96c8-43b4d8a45a13 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] VM Resumed (Lifecycle Event)
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Instance spawned successfully.
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-9223adde-1438-43df-b1de-b3825c1d1609 req-fc007ba0-b1f1-445e-bb2c-d95fbd625cde service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9223adde-1438-43df-b1de-b3825c1d1609 req-fc007ba0-b1f1-445e-bb2c-d95fbd625cde service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9223adde-1438-43df-b1de-b3825c1d1609 req-fc007ba0-b1f1-445e-bb2c-d95fbd625cde service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9223adde-1438-43df-b1de-b3825c1d1609 req-fc007ba0-b1f1-445e-bb2c-d95fbd625cde service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-9223adde-1438-43df-b1de-b3825c1d1609 req-fc007ba0-b1f1-445e-bb2c-d95fbd625cde service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:12:01 user nova-compute[72184]: WARNING nova.compute.manager [req-9223adde-1438-43df-b1de-b3825c1d1609 req-fc007ba0-b1f1-445e-bb2c-d95fbd625cde service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received unexpected event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with vm_state building and task_state spawning.
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909921.030599, 0b618734-f7e5-4faf-96c8-43b4d8a45a13 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] VM Started (Lifecycle Event)
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:01 user nova-compute[72184]: INFO nova.compute.manager [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Took 13.27 seconds to build instance.
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c9347962-8b62-460c-b77a-c8d9abdd0588 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.374s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:12:01 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-changed-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Refreshing instance network info cache due to event network-changed-445659c5-5542-4629-9a26-80aca641662f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.network.neutron [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Refreshing network info cache for port 445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:12:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8160MB free_disk=25.328510284423828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0b618734-f7e5-4faf-96c8-43b4d8a45a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:12:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updated VIF entry in instance network info cache for port 445659c5-5542-4629-9a26-80aca641662f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-25d61c8c-0d4b-45d3-b794-265f384b6f73 req-e189e2f3-11ac-400e-a708-218d9dc766b4 service nova] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:12:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:06 user nova-compute[72184]: INFO nova.compute.manager [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Attaching volume 4bec462e-de02-49ce-a8f3-8f0b4844a299 to /dev/vdb
Aug 01 17:12:06 user nova-compute[72184]: DEBUG os_brick.utils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0a08bf-1028-4cad-a512-d42de09f5844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5752cbc-b234-45f0-8685-4c1368d34e56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd2f1fd-c4fa-490f-944c-e33fb3e54f33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98dd814-46bc-4e37-bfba-0c99a3f392d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:12:06 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[71577d2c-94f7-48d9-9bef-79151b6e696b]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG os_brick.utils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating existing volume attachment record: 43f2de6d-0993-4b1f-bee3-efd7bbc96b33 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [{"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-0aa80855-fc9c-4fc3-9afc-42fff581a74e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:12:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:12:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:12:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:12:13 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:12:13 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:12:13 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb6c98e-16ef-4bfa-82e0-7b39816413a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:12:13 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb413e4-a275-46bb-bfb9-3e866de8164f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299] added
Aug 01 17:12:13 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:13 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61e618b-1f75-4809-8b44-88b8ca8e1a92]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[08193da3-d201-4ad6-a51d-6e83a57345ce]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUfvAJSY {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUfvAJSY" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4a344f-45bc-4066-8cf3-d07259cff922]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUfvAJSY'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ff1c2-2de8-481c-baae-a4aa6d5295bf]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[036027c7-8cad-42aa-bda9-31f1c30007ff]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:12:14 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:12:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:12:14 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:12:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --login" returned: 0 in 1.057s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb54f4-5751-4e3a-9fc3-bccd2cf5ccb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]
Aug 01 17:12:15 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.
Aug 01 17:12:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5046fb7-6824-457a-9850-177a15bbc084]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c25773b-dbc0-4a6b-b7c7-fcb3910e62f6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:12:15 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:12:15 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:12:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:12:15 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:12:15 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:12:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.273s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[001677c5-3f82-4223-bfcd-68690b047758]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:12:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.307s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== connect_volume: return (2309ms) {'type': 'block', 'scsi_wwn': '26465653463366232', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465653463366232', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:12:16 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:12:16 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:12:16 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:12:16 user nova-compute[72184]:   <serial>4bec462e-de02-49ce-a8f3-8f0b4844a299</serial>
Aug 01 17:12:16 user nova-compute[72184]: </disk>
Aug 01 17:12:16 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No VIF found with MAC fa:16:3e:4f:48:93, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:12:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1bce57d2-2670-4c9e-aa74-1d1b94a4652c tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.404s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72184) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-db2db461-d102-45f2-b789-2113e267d458 req-ec40beea-812f-4f84-99cc-24bdc88b65d3 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db2db461-d102-45f2-b789-2113e267d458 req-ec40beea-812f-4f84-99cc-24bdc88b65d3 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db2db461-d102-45f2-b789-2113e267d458 req-ec40beea-812f-4f84-99cc-24bdc88b65d3 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-db2db461-d102-45f2-b789-2113e267d458 req-ec40beea-812f-4f84-99cc-24bdc88b65d3 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:17 user nova-compute[72184]: DEBUG nova.compute.manager [req-db2db461-d102-45f2-b789-2113e267d458 req-ec40beea-812f-4f84-99cc-24bdc88b65d3 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:12:17 user nova-compute[72184]: WARNING nova.compute.manager [req-db2db461-d102-45f2-b789-2113e267d458 req-ec40beea-812f-4f84-99cc-24bdc88b65d3 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state active and task_state powering-off.
Aug 01 17:12:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance destroyed successfully.
Aug 01 17:12:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1c7d5a29-a4fa-4014-b725-5b236c194474 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.866s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ab78d05-a988-4025-8d88-b3214abf0da9 req-fade0c63-2d22-4941-a732-b7d344d73b68 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ab78d05-a988-4025-8d88-b3214abf0da9 req-fade0c63-2d22-4941-a732-b7d344d73b68 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ab78d05-a988-4025-8d88-b3214abf0da9 req-fade0c63-2d22-4941-a732-b7d344d73b68 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ab78d05-a988-4025-8d88-b3214abf0da9 req-fade0c63-2d22-4941-a732-b7d344d73b68 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ab78d05-a988-4025-8d88-b3214abf0da9 req-fade0c63-2d22-4941-a732-b7d344d73b68 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:12:19 user nova-compute[72184]: WARNING nova.compute.manager [req-3ab78d05-a988-4025-8d88-b3214abf0da9 req-fade0c63-2d22-4941-a732-b7d344d73b68 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state stopped and task_state None.
Aug 01 17:12:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:33 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909938.1151915, 48948157-6480-4c91-935d-37cd84a8b12c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:12:33 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Stopped (Lifecycle Event)
Aug 01 17:12:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a9bdbd6b-68a0-489e-a068-399c317aca5e None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a9bdbd6b-68a0-489e-a068-399c317aca5e None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:12:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:12:40 user nova-compute[72184]: INFO nova.compute.claims [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Claim successful on node user
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:12:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.policy [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80fcd66a964e435e9b6494c67e6a9c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fc1bb5f955400196d88dbc81346bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:12:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:12:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Creating image(s)
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.169s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk 1073741824" returned: 0 in 0.047s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Successfully created port: 5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Cannot resize image /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'migration_context' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Ensure instance console log exists: /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Successfully updated port: 5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing instance network info cache due to event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance network_info: |[{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.neutron [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Start _get_guest_xml network_info=[{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:12:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:12:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1292560231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1292560231',id=40,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO67PZsPYZ8xmaJ30U8JUyLtBfAghfo/cD30xvMocfHHS8ijjAlFMx/CgPDCX/ajwRrpC+dJwwxYQwJpyS09ymzkamKC6EMhcFkLg6UtIf9w9baQKprKGmw9D2hC4CxGaQ==',key_name='tempest-keypair-239810973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-e1qxq807',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=d1dd83d5-7a23-4ad2-878d-77a06c31d032,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'pci_devices' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:12:42 user nova-compute[72184]:   <uuid>d1dd83d5-7a23-4ad2-878d-77a06c31d032</uuid>
Aug 01 17:12:42 user nova-compute[72184]:   <name>instance-00000028</name>
Aug 01 17:12:42 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:12:42 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:12:42 user nova-compute[72184]:   <metadata>
Aug 01 17:12:42 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:12:42 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:12:42 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1292560231</nova:name>
Aug 01 17:12:42 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:12:42</nova:creationTime>
Aug 01 17:12:42 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:12:42 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:12:42 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:12:42 user nova-compute[72184]:       <nova:owner>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:user uuid="80fcd66a964e435e9b6494c67e6a9c14">tempest-AttachVolumeShelveTestJSON-1405411677-project-member</nova:user>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:project uuid="77fc1bb5f955400196d88dbc81346bb5">tempest-AttachVolumeShelveTestJSON-1405411677</nova:project>
Aug 01 17:12:42 user nova-compute[72184]:       </nova:owner>
Aug 01 17:12:42 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:12:42 user nova-compute[72184]:       <nova:ports>
Aug 01 17:12:42 user nova-compute[72184]:         <nova:port uuid="5d434ee0-529b-4df1-a3de-88abd908cd8a">
Aug 01 17:12:42 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:12:42 user nova-compute[72184]:         </nova:port>
Aug 01 17:12:42 user nova-compute[72184]:       </nova:ports>
Aug 01 17:12:42 user nova-compute[72184]:     </nova:instance>
Aug 01 17:12:42 user nova-compute[72184]:   </metadata>
Aug 01 17:12:42 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:12:42 user nova-compute[72184]:     <system>
Aug 01 17:12:42 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:12:42 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:12:42 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:12:42 user nova-compute[72184]:       <entry name="serial">d1dd83d5-7a23-4ad2-878d-77a06c31d032</entry>
Aug 01 17:12:42 user nova-compute[72184]:       <entry name="uuid">d1dd83d5-7a23-4ad2-878d-77a06c31d032</entry>
Aug 01 17:12:42 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:12:42 user nova-compute[72184]:     </system>
Aug 01 17:12:42 user nova-compute[72184]:   </sysinfo>
Aug 01 17:12:42 user nova-compute[72184]:   <os>
Aug 01 17:12:42 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:12:42 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:12:42 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:12:42 user nova-compute[72184]:   </os>
Aug 01 17:12:42 user nova-compute[72184]:   <features>
Aug 01 17:12:42 user nova-compute[72184]:     <acpi/>
Aug 01 17:12:42 user nova-compute[72184]:     <apic/>
Aug 01 17:12:42 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:12:42 user nova-compute[72184]:   </features>
Aug 01 17:12:42 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:12:42 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:12:42 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:12:42 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:12:42 user nova-compute[72184]:   </clock>
Aug 01 17:12:42 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:12:42 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:12:42 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:12:42 user nova-compute[72184]:   </cpu>
Aug 01 17:12:42 user nova-compute[72184]:   <devices>
Aug 01 17:12:42 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:12:42 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:12:42 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk"/>
Aug 01 17:12:42 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:12:42 user nova-compute[72184]:     </disk>
Aug 01 17:12:42 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:12:42 user nova-compute[72184]:       <mac address="fa:16:3e:3e:9d:2f"/>
Aug 01 17:12:42 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:12:42 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:12:42 user nova-compute[72184]:       <target dev="tap5d434ee0-52"/>
Aug 01 17:12:42 user nova-compute[72184]:     </interface>
Aug 01 17:12:42 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:12:42 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/console.log" append="off"/>
Aug 01 17:12:42 user nova-compute[72184]:     </serial>
Aug 01 17:12:42 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:12:42 user nova-compute[72184]:     <video>
Aug 01 17:12:42 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:12:42 user nova-compute[72184]:     </video>
Aug 01 17:12:42 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:12:42 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:12:42 user nova-compute[72184]:     </rng>
Aug 01 17:12:42 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:12:42 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:12:42 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:12:42 user nova-compute[72184]:     </memballoon>
Aug 01 17:12:42 user nova-compute[72184]:   </devices>
Aug 01 17:12:42 user nova-compute[72184]: </domain>
Aug 01 17:12:42 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1292560231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1292560231',id=40,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO67PZsPYZ8xmaJ30U8JUyLtBfAghfo/cD30xvMocfHHS8ijjAlFMx/CgPDCX/ajwRrpC+dJwwxYQwJpyS09ymzkamKC6EMhcFkLg6UtIf9w9baQKprKGmw9D2hC4CxGaQ==',key_name='tempest-keypair-239810973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-e1qxq807',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=d1dd83d5-7a23-4ad2-878d-77a06c31d032,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG os_vif [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d434ee0-52, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d434ee0-52, col_values=(('external_ids', {'iface-id': '5d434ee0-529b-4df1-a3de-88abd908cd8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9d:2f', 'vm-uuid': 'd1dd83d5-7a23-4ad2-878d-77a06c31d032'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:42 user nova-compute[72184]: INFO os_vif [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52')
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:12:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No VIF found with MAC fa:16:3e:3e:9d:2f, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:12:43 user nova-compute[72184]: DEBUG nova.network.neutron [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updated VIF entry in instance network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:12:43 user nova-compute[72184]: DEBUG nova.network.neutron [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:12:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-55af551f-4250-4a4e-b3a4-e48332ad94f2 req-be81bb4b-13ee-4484-a23c-2f89efa5cf85 service nova] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0791eba6-1f8d-4eb1-a2fe-caa439928139 req-9f03ad49-826e-48d5-ab53-bb7aec515ece service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0791eba6-1f8d-4eb1-a2fe-caa439928139 req-9f03ad49-826e-48d5-ab53-bb7aec515ece service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0791eba6-1f8d-4eb1-a2fe-caa439928139 req-9f03ad49-826e-48d5-ab53-bb7aec515ece service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0791eba6-1f8d-4eb1-a2fe-caa439928139 req-9f03ad49-826e-48d5-ab53-bb7aec515ece service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0791eba6-1f8d-4eb1-a2fe-caa439928139 req-9f03ad49-826e-48d5-ab53-bb7aec515ece service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:12:44 user nova-compute[72184]: WARNING nova.compute.manager [req-0791eba6-1f8d-4eb1-a2fe-caa439928139 req-9f03ad49-826e-48d5-ab53-bb7aec515ece service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state building and task_state spawning.
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909966.2995787, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] VM Resumed (Lifecycle Event)
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance spawned successfully.
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690909966.301108, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] VM Started (Lifecycle Event)
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-72f1a91e-b3f6-4aee-a4d1-d1a8cac16983 req-b8af013d-9fc1-4522-a5cb-9a901ec5ebb4 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-72f1a91e-b3f6-4aee-a4d1-d1a8cac16983 req-b8af013d-9fc1-4522-a5cb-9a901ec5ebb4 service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-72f1a91e-b3f6-4aee-a4d1-d1a8cac16983 req-b8af013d-9fc1-4522-a5cb-9a901ec5ebb4 service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-72f1a91e-b3f6-4aee-a4d1-d1a8cac16983 req-b8af013d-9fc1-4522-a5cb-9a901ec5ebb4 service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-72f1a91e-b3f6-4aee-a4d1-d1a8cac16983 req-b8af013d-9fc1-4522-a5cb-9a901ec5ebb4 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:12:46 user nova-compute[72184]: WARNING nova.compute.manager [req-72f1a91e-b3f6-4aee-a4d1-d1a8cac16983 req-b8af013d-9fc1-4522-a5cb-9a901ec5ebb4 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state building and task_state spawning.
Aug 01 17:12:46 user nova-compute[72184]: INFO nova.compute.manager [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Took 6.00 seconds to build instance.
Aug 01 17:12:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8d3e5d80-0e02-4bec-a2bf-d7eba573eae0 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.102s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:12:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:12:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:12:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:01 user nova-compute[72184]: INFO nova.compute.manager [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Terminating instance
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-160aea08-d8b4-4e11-adb1-62d01ba22382 req-716551bb-3d6c-4bf7-a93f-010cea326408 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-160aea08-d8b4-4e11-adb1-62d01ba22382 req-716551bb-3d6c-4bf7-a93f-010cea326408 service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-160aea08-d8b4-4e11-adb1-62d01ba22382 req-716551bb-3d6c-4bf7-a93f-010cea326408 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-160aea08-d8b4-4e11-adb1-62d01ba22382 req-716551bb-3d6c-4bf7-a93f-010cea326408 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-160aea08-d8b4-4e11-adb1-62d01ba22382 req-716551bb-3d6c-4bf7-a93f-010cea326408 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-160aea08-d8b4-4e11-adb1-62d01ba22382 req-716551bb-3d6c-4bf7-a93f-010cea326408 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-unplugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Instance destroyed successfully.
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'resources' on Instance uuid 0aa80855-fc9c-4fc3-9afc-42fff581a74e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1155008516',display_name='tempest-ServerActionsTestOtherA-server-1155008516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1155008516',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-d072894v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=0aa80855-fc9c-4fc3-9afc-42fff581a74e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "address": "fa:16:3e:df:ac:1c", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68d1d0-09", "ovs_interfaceid": "1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG os_vif [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a68d1d0-09, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:02 user nova-compute[72184]: INFO os_vif [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68d1d0-09')
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkiUftyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:02 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5af8a-1e98-439e-9c82-9cf6936294c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[421d28d7-b725-4ac3-a0bd-2303f8958c76]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:13:02 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:02 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be (non-flash)
Aug 01 17:13:02 user nova-compute[72184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:02 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c72bb68-554e-4321-8a50-4eeff579d632]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1d834-dbd2-4695-be8a-234557b7511d]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48602f35-4186-44d1-8ceb-d7d1d7c2744a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42e0f6-edeb-473b-b1fe-463e78a4bab5]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6c08ec8c-afceb6c9c17a1882', '/dev/disk/by-id/scsi-26166636562366339', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c08ec8c') {{(pid=83397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d5e5ce-6041-4b37-9f46-fb2e4d72431f]: (4, None) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66fcf8-2dc1-43c7-998b-c59b39a7081a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c64a2-f11a-486d-a5d4-6bdffb6ee2f8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260]
Aug 01 17:13:02 user nova-compute[72184]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be, portal: 172.16.0.220,3260] successful.
Aug 01 17:13:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539640be-b67b-4c4c-828f-1549014677be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc87e5-763e-4bd3-999f-e5ebf88d82df]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] <== disconnect_volume: return (425ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:13:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Deleting instance files /opt/stack/data/nova/instances/0aa80855-fc9c-4fc3-9afc-42fff581a74e_del
Aug 01 17:13:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Deletion of /opt/stack/data/nova/instances/0aa80855-fc9c-4fc3-9afc-42fff581a74e_del complete
Aug 01 17:13:02 user nova-compute[72184]: INFO nova.compute.manager [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:03 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Took 1.47 seconds to deallocate network for instance.
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-f56bf881-2c8f-4649-aab2-3a6161cf57de req-2123de2a-64bc-4d9a-8f7a-83fe4cbefb76 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-deleted-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:03 user nova-compute[72184]: INFO nova.compute.manager [req-f56bf881-2c8f-4649-aab2-3a6161cf57de req-2123de2a-64bc-4d9a-8f7a-83fe4cbefb76 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Neutron deleted interface 1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f; detaching it from the instance and deleting it from the info cache
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.network.neutron [req-f56bf881-2c8f-4649-aab2-3a6161cf57de req-2123de2a-64bc-4d9a-8f7a-83fe4cbefb76 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-357fdb71-0230-4c53-b15d-a4dc0073282b req-91ab17ce-3da7-4747-801f-b0ee56b587d6 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-357fdb71-0230-4c53-b15d-a4dc0073282b req-91ab17ce-3da7-4747-801f-b0ee56b587d6 service nova] Acquiring lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-357fdb71-0230-4c53-b15d-a4dc0073282b req-91ab17ce-3da7-4747-801f-b0ee56b587d6 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-357fdb71-0230-4c53-b15d-a4dc0073282b req-91ab17ce-3da7-4747-801f-b0ee56b587d6 service nova] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:03 user nova-compute[72184]: DEBUG nova.compute.manager [req-357fdb71-0230-4c53-b15d-a4dc0073282b req-91ab17ce-3da7-4747-801f-b0ee56b587d6 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] No waiting events found dispatching network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:13:03 user nova-compute[72184]: WARNING nova.compute.manager [req-357fdb71-0230-4c53-b15d-a4dc0073282b req-91ab17ce-3da7-4747-801f-b0ee56b587d6 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Received unexpected event network-vif-plugged-1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f for instance with vm_state active and task_state deleting.
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-f56bf881-2c8f-4649-aab2-3a6161cf57de req-2123de2a-64bc-4d9a-8f7a-83fe4cbefb76 service nova] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Detach interface failed, port_id=1a68d1d0-097d-4ab0-8f0e-f2ac12cd680f, reason: Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:13:04 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:13:04 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=25.297382354736328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0b618734-f7e5-4faf-96c8-43b4d8a45a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:04 user nova-compute[72184]: INFO nova.compute.manager [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 17:13:04 user nova-compute[72184]: DEBUG nova.compute.manager [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Deleting volume: 539640be-b67b-4c4c-828f-1549014677be {{(pid=72184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:05 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:13:05 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:13:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:05 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Deleted allocations for instance 0aa80855-fc9c-4fc3-9afc-42fff581a74e
Aug 01 17:13:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ffcf8a40-8329-490e-a33d-2b8058bf2a0b tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "0aa80855-fc9c-4fc3-9afc-42fff581a74e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.097s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:13:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:13:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:13:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:13:16 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690909981.9427063, 0aa80855-fc9c-4fc3-9afc-42fff581a74e => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:13:16 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] VM Stopped (Lifecycle Event)
Aug 01 17:13:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-33550a08-f64c-4128-a53c-db86b1f9260b None None] [instance: 0aa80855-fc9c-4fc3-9afc-42fff581a74e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:13:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG nova.compute.manager [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-changed-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG nova.compute.manager [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Refreshing instance network info cache due to event network-changed-fc0db13b-b4b3-4395-949f-90dae118b6dd. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] Acquiring lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] Acquired lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Refreshing network info cache for port fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updated VIF entry in instance network info cache for port fc0db13b-b4b3-4395-949f-90dae118b6dd. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating instance_info_cache with network_info: [{"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a09acfb6-63b8-4a4a-b128-ba72031b01ad req-995f41c0-a45c-47b5-bfb2-05276b7de95a service nova] Releasing lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'flavor' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:29 user nova-compute[72184]: INFO nova.compute.manager [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attaching volume eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 to /dev/vdb
Aug 01 17:13:29 user nova-compute[72184]: DEBUG os_brick.utils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d0e97-5ef7-49a9-9242-14362351ff42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06adee94-3fd3-476d-9c33-5c68085068cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[965f347b-100b-438b-b20d-146c4e333d04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e269d4d-c645-4cb5-b771-1a421a3852b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:13:29 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:13:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0f9ea-ee97-44ee-9861-1b92e3881ddd]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG os_brick.utils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating existing volume attachment record: e07bf360-d692-4e93-9855-7b9c9c3110bf {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:13:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nglybSjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:36 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:13:36 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:13:36 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a8b860-5d80-45e6-8d45-db2c34e67383]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:13:36 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c02549-fd57-4439-970b-38e7aeaa93c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283] added
Aug 01 17:13:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[412136a6-5e81-4f00-96cc-3b1d7489ce80]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7753fd9-4fd0-47d3-8295-d5accbad31e1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nglybSjr {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nglybSjr" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e896de4a-88f5-4c1a-b4b6-c4d230894fa6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nglybSjr'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99115dda-aae7-49c2-97d4-a63a1ebcb138]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b93a2c-3ad6-4cea-8043-e82086f77a52]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:36 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:36 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b802b39-70e6-4562-b0df-e1de95d1ba9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260]
Aug 01 17:13:36 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260] successful.
Aug 01 17:13:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364e8bd-0595-4fce-8511-86574b17b95e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0fffac-13ff-4fb1-9cfb-329fc8bfcd65]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:36 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:36 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:36 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:36 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:36 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ada275-46c2-4238-8374-7d0196d6dd08]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:36 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nglybSjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23530336235363466', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530336235363466', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'flavor' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:13:37 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:13:37 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:13:37 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:13:37 user nova-compute[72184]:   <serial>eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283</serial>
Aug 01 17:13:37 user nova-compute[72184]: </disk>
Aug 01 17:13:37 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:13:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:13:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:13:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No VIF found with MAC fa:16:3e:f0:4c:69, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:13:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e97d02d1-a3d5-4fa9-a6b2-61d5baba2b33 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.476s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-changed-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Refreshing instance network info cache due to event network-changed-f6caefbf-2287-407b-bf3f-8e6e401e709f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] Acquiring lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] Acquired lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Refreshing network info cache for port f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updated VIF entry in instance network info cache for port f6caefbf-2287-407b-bf3f-8e6e401e709f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updating instance_info_cache with network_info: [{"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5a512240-67ed-4130-88e9-c59ad6856fb7 req-e20c2ddc-7fe2-461a-b311-9e93c599a8bf service nova] Releasing lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:13:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'flavor' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:41 user nova-compute[72184]: INFO nova.compute.manager [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attaching volume 842d5df4-2912-45bd-a2ff-a2e12b3525c1 to /dev/vdc
Aug 01 17:13:42 user nova-compute[72184]: DEBUG os_brick.utils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c54e4-171b-4b83-b3d2-947ded0ed6c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d63aa-7708-4b1e-b249-91fd1a1363ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc76a1-ca90-4e2a-a34e-065f92fb9a59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e4b98-37ce-4628-aaf7-76fbf954f8fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:13:42 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:13:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b014c3-9805-45ac-bab1-2f5f916d5442]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG os_brick.utils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:42 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating existing volume attachment record: 093d9915-4217-43e0-a390-8fe8072889dd {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:13:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "c8822b9c-78cc-4cac-9549-26197a664abb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:13:48 user nova-compute[72184]: INFO nova.compute.claims [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Claim successful on node user
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:13:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:13:48 user nova-compute[72184]: INFO nova.virt.block_device [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Booting with volume snapshot 2e4102e8-db77-407e-b902-f77c931789b3 at /dev/vda
Aug 01 17:13:48 user nova-compute[72184]: DEBUG nova.policy [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce144879b7e4638822f0d7174693575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf5145289cf4667b9398df4a8266bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVWkzxsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:49 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:13:49 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:13:49 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1fa7d-153d-4fc1-96a8-1cc45d3bb0b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:13:49 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc1be9-4281-43c6-ac43-51625143b925]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1] added
Aug 01 17:13:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[221aa1fe-d8e4-4425-8766-c81d72d2eac2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9889b4-8453-481f-9f74-9c0b12d02dc0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVWkzxsa {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVWkzxsa" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0188ff-256c-4a3f-8403-461ae8e4d70a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVWkzxsa'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1857822-ab86-485c-a312-18347d8d5c52]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d15fb0a-974e-484c-a793-c4d2ff0e3638]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c2d26-09f9-4676-a760-0a61f27c7e45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260]
Aug 01 17:13:49 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260] successful.
Aug 01 17:13:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473b67f-4a35-424f-90d9-eac4a7adecfa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c5aab5-d677-40c9-8abf-17a43a673422]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 (non-flash)
Aug 01 17:13:49 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ee5eed-dac1-42c4-ab89-4fc0dce7102c]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVWkzxsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:13:49 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Successfully created port: 6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Successfully updated port: 6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquired lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-changed-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Refreshing instance network info cache due to event network-changed-6c07f6af-3152-45bb-94c6-989def8aafe6. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] Acquiring lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23766363732306439', 'path': '/dev/sde'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766363732306439', 'path': '/dev/sde'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'flavor' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:13:50 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:13:50 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 17:13:50 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:13:50 user nova-compute[72184]:   <serial>842d5df4-2912-45bd-a2ff-a2e12b3525c1</serial>
Aug 01 17:13:50 user nova-compute[72184]: </disk>
Aug 01 17:13:50 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.network.neutron [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updating instance_info_cache with network_info: [{"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Releasing lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Instance network_info: |[{"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] Acquired lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Refreshing network info cache for port 6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] No VIF found with MAC fa:16:3e:f0:4c:69, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6dec135c-aa4c-405b-82ce-83022255b931 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.556s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updated VIF entry in instance network info cache for port 6c07f6af-3152-45bb-94c6-989def8aafe6. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG nova.network.neutron [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updating instance_info_cache with network_info: [{"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-fb0cf302-94d7-468e-a223-f71d6b1f63a7 req-4d7729fd-434f-496e-ba81-4f4405d5a3c0 service nova] Releasing lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:51 user nova-compute[72184]: INFO nova.compute.manager [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Detaching volume 842d5df4-2912-45bd-a2ff-a2e12b3525c1
Aug 01 17:13:51 user nova-compute[72184]: INFO nova.virt.block_device [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attempting to driver detach volume 842d5df4-2912-45bd-a2ff-a2e12b3525c1 from mountpoint /dev/vdc
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Attempting to detach device vdc from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:13:52 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:13:52 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 17:13:52 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:13:52 user nova-compute[72184]:   <serial>842d5df4-2912-45bd-a2ff-a2e12b3525c1</serial>
Aug 01 17:13:52 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 17:13:52 user nova-compute[72184]: </disk>
Aug 01 17:13:52 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Successfully detached device vdc from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the persistent domain config.
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:13:52 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:13:52 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 17:13:52 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:13:52 user nova-compute[72184]:   <serial>842d5df4-2912-45bd-a2ff-a2e12b3525c1</serial>
Aug 01 17:13:52 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 17:13:52 user nova-compute[72184]: </disk>
Aug 01 17:13:52 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910032.448095, 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:13:52 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Successfully detached device vdc from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the live domain config.
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVWkzxsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72861a-eae3-42be-8847-e07cbdfb0df8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cbeadb-9f4b-498e-bfae-40211e65bb23]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:52 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:52 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:52 user nova-compute[72184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 (non-flash)
Aug 01 17:13:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:13:52 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:13:52 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:13:52 user nova-compute[72184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 (non-flash)
Aug 01 17:13:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30279a7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1'): ({'sde'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Removing single pathed devices sde {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5921d99-db1a-4582-8ef8-b47c929780d2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f828d-0736-42d5-8506-b66230fc761d]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Flushing IO for device /dev/sde {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc975cc5-bb51-490a-9c8e-d506a5c939f7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df018e81-c0fe-4257-966c-57b68328b2bb]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa7bc32-0d9d-4d3f-85b7-dcaa9e4246f7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6845f5bd-03c7-466d-a518-ffe0ef49d848]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260]
Aug 01 17:13:52 user nova-compute[72184]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1, portal: 172.16.0.220,3260] successful.
Aug 01 17:13:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:842d5df4-2912-45bd-a2ff-a2e12b3525c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27dbae6-13f9-4f1a-a402-3f811682fea7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] <== disconnect_volume: return (276ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:13:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'flavor' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-45347dd9-4244-471d-964b-ca0989b96ea8 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.580s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG os_brick.utils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f8366e-7d8b-4700-8f1b-5b0db02360fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fbc44-4b21-496c-a7cb-051af84bdb9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480808d-212d-4305-bedd-fd3b19ab1aff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dea8c0-8d4c-455a-953e-4e440b03050c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:13:54 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:13:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8aab32-39ee-4bc6-98d1-b766d9b754e7]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG os_brick.utils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updating existing volume attachment record: 5dc49ccd-7915-43e6-b0d6-b381cc6f1761 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:13:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:56 user nova-compute[72184]: INFO nova.compute.manager [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Terminating instance
Aug 01 17:13:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-260977c6-775e-4ab0-981f-7aa8d2d58f2f req-e9a5687b-1606-4373-91d9-b2a8bfdacf88 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-unplugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-260977c6-775e-4ab0-981f-7aa8d2d58f2f req-e9a5687b-1606-4373-91d9-b2a8bfdacf88 service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-260977c6-775e-4ab0-981f-7aa8d2d58f2f req-e9a5687b-1606-4373-91d9-b2a8bfdacf88 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-260977c6-775e-4ab0-981f-7aa8d2d58f2f req-e9a5687b-1606-4373-91d9-b2a8bfdacf88 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-260977c6-775e-4ab0-981f-7aa8d2d58f2f req-e9a5687b-1606-4373-91d9-b2a8bfdacf88 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-unplugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:13:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-260977c6-775e-4ab0-981f-7aa8d2d58f2f req-e9a5687b-1606-4373-91d9-b2a8bfdacf88 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-unplugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Instance destroyed successfully.
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.objects.instance [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lazy-loading 'resources' on Instance uuid 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T16:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-163759626',display_name='tempest-ServerActionsTestOtherA-server-483945621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-163759626',id=20,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeYVMLtucQtNVuyx6/HPHoaHGKika0SB9pZ/1ulvCJEYo/F3dC6B8/I6auq/inmiXcBeVrs42Z1J5f215asC+oqZc909B6CbrV9e8AmGSGR/HTq6OumD6jJW338QDW+w==',key_name='tempest-keypair-1177675939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:01:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ef0982d76ca40a48b457e0797d6837b',ramdisk_id='',reservation_id='r-smryrd3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143698002',owner_user_name='tempest-ServerActionsTestOtherA-2143698002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d472678ed94cb7ab09de7d72128f84',uuid=99df3b11-5b8e-4d64-bd50-fd9a4a7f821f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converting VIF {"id": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "address": "fa:16:3e:f4:23:78", "network": {"id": "e98651e0-97eb-4dde-9cf4-1bb260b2d044", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1388458535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ef0982d76ca40a48b457e0797d6837b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c311e0-02", "ovs_interfaceid": "d8c311e0-0221-4d18-8579-f30e351d6ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG os_vif [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c311e0-02, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:13:57 user nova-compute[72184]: INFO os_vif [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:23:78,bridge_name='br-int',has_traffic_filtering=True,id=d8c311e0-0221-4d18-8579-f30e351d6ad5,network=Network(e98651e0-97eb-4dde-9cf4-1bb260b2d044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c311e0-02')
Aug 01 17:13:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Deleting instance files /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f_del
Aug 01 17:13:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Deletion of /opt/stack/data/nova/instances/99df3b11-5b8e-4d64-bd50-fd9a4a7f821f_del complete
Aug 01 17:13:57 user nova-compute[72184]: INFO nova.compute.manager [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 01 17:13:57 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:13:57 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Took 0.57 seconds to deallocate network for instance.
Aug 01 17:13:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:57 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:58 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Deleted allocations for instance 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f
Aug 01 17:13:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-414109ea-f669-4e8e-a635-f2c5baeb8b03 tempest-ServerActionsTestOtherA-2143698002 tempest-ServerActionsTestOtherA-2143698002-project-member] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] Acquiring lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] Lock "99df3b11-5b8e-4d64-bd50-fd9a4a7f821f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] No waiting events found dispatching network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:13:58 user nova-compute[72184]: WARNING nova.compute.manager [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received unexpected event network-vif-plugged-d8c311e0-0221-4d18-8579-f30e351d6ad5 for instance with vm_state deleted and task_state None.
Aug 01 17:13:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-a3aa8fcc-a57a-4ccb-8758-a9f4529f52ba req-3c53407d-0892-44dc-887e-c4a87efdf5e5 service nova] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Received event network-vif-deleted-d8c311e0-0221-4d18-8579-f30e351d6ad5 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:13:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:14:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Creating image(s)
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Ensure instance console log exists: /opt/stack/data/nova/instances/c8822b9c-78cc-4cac-9549-26197a664abb/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Start _get_guest_xml network_info=[{"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T17:13:42Z,direct_url=<?>,disk_format='qcow2',id=b473fcbc-2394-4bd0-92c0-701c9758dde8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1975168185',owner='7cf5145289cf4667b9398df4a8266bb4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T17:13:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '5dc49ccd-7915-43e6-b0d6-b381cc6f1761', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPJBYqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8822b9c-78cc-4cac-9549-26197a664abb', 'attached_at': '', 'detached_at': '', 'volume_id': '7b78e7f0-17cc-4286-81bd-cd304335c994', 'serial': '7b78e7f0-17cc-4286-81bd-cd304335c994'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:14:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:14:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T17:13:42Z,direct_url=<?>,disk_format='qcow2',id=b473fcbc-2394-4bd0-92c0-701c9758dde8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1975168185',owner='7cf5145289cf4667b9398df4a8266bb4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T17:13:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPJBYqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:14:02 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:14:02 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:14:02 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2e68e-92ff-4680-82b6-cb3ab61ef9ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:14:02 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6da80e2-7e81-4ac1-9bf4-8f8380aff5d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994] added
Aug 01 17:14:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5339b4-6863-4d89-8224-d35d7d99979c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f8166f-7281-4ba9-b2ae-99b08fce9ad8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPJBYqCF {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPJBYqCF" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e30825-d4f7-494c-806c-0fafbdb92402]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPJBYqCF'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe24ffbe-7597-433d-87b2-24b5c2e57e5c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbbbf5e-4ad0-4d78-b21d-9931f5571aaa]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[42525741-3f13-4259-a9c2-5903128485ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260]
Aug 01 17:14:02 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260] successful.
Aug 01 17:14:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed66fb2-14d6-4428-8f5a-79852cc5e629]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744781a-e716-44a6-814a-cbd2ff9827b2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66213122-4e97-4029-b0e0-7a8168ac654d]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPJBYqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26463363631336366', 'path': '/dev/sde'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463363631336366', 'path': '/dev/sde'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-637784130',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-637784130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-637784130',id=41,image_ref='b473fcbc-2394-4bd0-92c0-701c9758dde8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAuL3QKBQ3pd5dPkoWTrpFBp6y5hLVuKUI3S0SmYqjPTW2SoVjq863Vhkcw5T3iqk8V2dshYJDnnR2o+7IdyjIeJ4Jcu7XHEXYCAmHKbLv/t90uKTiicnOCpJm39rVVng==',key_name='tempest-keypair-273005031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-idv6tsmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1490009883',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce144879b7e4638822f0d7174693575',uuid=c8822b9c-78cc-4cac-9549-26197a664abb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'pci_devices' on Instance uuid c8822b9c-78cc-4cac-9549-26197a664abb {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:14:03 user nova-compute[72184]:   <uuid>c8822b9c-78cc-4cac-9549-26197a664abb</uuid>
Aug 01 17:14:03 user nova-compute[72184]:   <name>instance-00000029</name>
Aug 01 17:14:03 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:14:03 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:14:03 user nova-compute[72184]:   <metadata>
Aug 01 17:14:03 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:14:03 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:14:03 user nova-compute[72184]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-637784130</nova:name>
Aug 01 17:14:03 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:14:02</nova:creationTime>
Aug 01 17:14:03 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:14:03 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:14:03 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:14:03 user nova-compute[72184]:       <nova:owner>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:user uuid="9ce144879b7e4638822f0d7174693575">tempest-TestVolumeBootPattern-1490009883-project-member</nova:user>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:project uuid="7cf5145289cf4667b9398df4a8266bb4">tempest-TestVolumeBootPattern-1490009883</nova:project>
Aug 01 17:14:03 user nova-compute[72184]:       </nova:owner>
Aug 01 17:14:03 user nova-compute[72184]:       <nova:root type="image" uuid="b473fcbc-2394-4bd0-92c0-701c9758dde8"/>
Aug 01 17:14:03 user nova-compute[72184]:       <nova:ports>
Aug 01 17:14:03 user nova-compute[72184]:         <nova:port uuid="6c07f6af-3152-45bb-94c6-989def8aafe6">
Aug 01 17:14:03 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 17:14:03 user nova-compute[72184]:         </nova:port>
Aug 01 17:14:03 user nova-compute[72184]:       </nova:ports>
Aug 01 17:14:03 user nova-compute[72184]:     </nova:instance>
Aug 01 17:14:03 user nova-compute[72184]:   </metadata>
Aug 01 17:14:03 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:14:03 user nova-compute[72184]:     <system>
Aug 01 17:14:03 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:14:03 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:14:03 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:14:03 user nova-compute[72184]:       <entry name="serial">c8822b9c-78cc-4cac-9549-26197a664abb</entry>
Aug 01 17:14:03 user nova-compute[72184]:       <entry name="uuid">c8822b9c-78cc-4cac-9549-26197a664abb</entry>
Aug 01 17:14:03 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:14:03 user nova-compute[72184]:     </system>
Aug 01 17:14:03 user nova-compute[72184]:   </sysinfo>
Aug 01 17:14:03 user nova-compute[72184]:   <os>
Aug 01 17:14:03 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:14:03 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:14:03 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:14:03 user nova-compute[72184]:   </os>
Aug 01 17:14:03 user nova-compute[72184]:   <features>
Aug 01 17:14:03 user nova-compute[72184]:     <acpi/>
Aug 01 17:14:03 user nova-compute[72184]:     <apic/>
Aug 01 17:14:03 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:14:03 user nova-compute[72184]:   </features>
Aug 01 17:14:03 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:14:03 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:14:03 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:14:03 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:14:03 user nova-compute[72184]:   </clock>
Aug 01 17:14:03 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:14:03 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:14:03 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:14:03 user nova-compute[72184]:   </cpu>
Aug 01 17:14:03 user nova-compute[72184]:   <devices>
Aug 01 17:14:03 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:14:03 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:14:03 user nova-compute[72184]:       <source dev="/dev/sde"/>
Aug 01 17:14:03 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:14:03 user nova-compute[72184]:       <serial>7b78e7f0-17cc-4286-81bd-cd304335c994</serial>
Aug 01 17:14:03 user nova-compute[72184]:     </disk>
Aug 01 17:14:03 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:14:03 user nova-compute[72184]:       <mac address="fa:16:3e:d0:32:fd"/>
Aug 01 17:14:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:14:03 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:14:03 user nova-compute[72184]:       <target dev="tap6c07f6af-31"/>
Aug 01 17:14:03 user nova-compute[72184]:     </interface>
Aug 01 17:14:03 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:14:03 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/c8822b9c-78cc-4cac-9549-26197a664abb/console.log" append="off"/>
Aug 01 17:14:03 user nova-compute[72184]:     </serial>
Aug 01 17:14:03 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:14:03 user nova-compute[72184]:     <video>
Aug 01 17:14:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:14:03 user nova-compute[72184]:     </video>
Aug 01 17:14:03 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:14:03 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:14:03 user nova-compute[72184]:     </rng>
Aug 01 17:14:03 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:14:03 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:14:03 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:14:03 user nova-compute[72184]:     </memballoon>
Aug 01 17:14:03 user nova-compute[72184]:   </devices>
Aug 01 17:14:03 user nova-compute[72184]: </domain>
Aug 01 17:14:03 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-637784130',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-637784130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-637784130',id=41,image_ref='b473fcbc-2394-4bd0-92c0-701c9758dde8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAuL3QKBQ3pd5dPkoWTrpFBp6y5hLVuKUI3S0SmYqjPTW2SoVjq863Vhkcw5T3iqk8V2dshYJDnnR2o+7IdyjIeJ4Jcu7XHEXYCAmHKbLv/t90uKTiicnOCpJm39rVVng==',key_name='tempest-keypair-273005031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-idv6tsmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1490009883',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce144879b7e4638822f0d7174693575',uuid=c8822b9c-78cc-4cac-9549-26197a664abb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG os_vif [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c07f6af-31, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c07f6af-31, col_values=(('external_ids', {'iface-id': '6c07f6af-3152-45bb-94c6-989def8aafe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:32:fd', 'vm-uuid': 'c8822b9c-78cc-4cac-9549-26197a664abb'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:03 user nova-compute[72184]: INFO os_vif [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31')
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No VIF found with MAC fa:16:3e:d0:32:fd, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:14:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1e0dd67-1cf0-4213-9089-20037c1fe912 req-174f4858-947e-426c-b5d3-3d0a73b2cf0b service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1e0dd67-1cf0-4213-9089-20037c1fe912 req-174f4858-947e-426c-b5d3-3d0a73b2cf0b service nova] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1e0dd67-1cf0-4213-9089-20037c1fe912 req-174f4858-947e-426c-b5d3-3d0a73b2cf0b service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c1e0dd67-1cf0-4213-9089-20037c1fe912 req-174f4858-947e-426c-b5d3-3d0a73b2cf0b service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-c1e0dd67-1cf0-4213-9089-20037c1fe912 req-174f4858-947e-426c-b5d3-3d0a73b2cf0b service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] No waiting events found dispatching network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:14:05 user nova-compute[72184]: WARNING nova.compute.manager [req-c1e0dd67-1cf0-4213-9089-20037c1fe912 req-174f4858-947e-426c-b5d3-3d0a73b2cf0b service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received unexpected event network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 for instance with vm_state building and task_state spawning.
Aug 01 17:14:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:14:06 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:14:06 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=25.320701599121094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0b618734-f7e5-4faf-96c8-43b4d8a45a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance c8822b9c-78cc-4cac-9549-26197a664abb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:14:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910047.1432712, c8822b9c-78cc-4cac-9549-26197a664abb => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] VM Resumed (Lifecycle Event)
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Instance spawned successfully.
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910047.1470685, c8822b9c-78cc-4cac-9549-26197a664abb => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] VM Started (Lifecycle Event)
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:14:07 user nova-compute[72184]: INFO nova.compute.manager [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Took 18.99 seconds to build instance.
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-7286410e-d9f9-42a1-a022-723cc4a3a89b req-78adabe4-484f-4a81-848c-a084a6bad7bf service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7286410e-d9f9-42a1-a022-723cc4a3a89b req-78adabe4-484f-4a81-848c-a084a6bad7bf service nova] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7286410e-d9f9-42a1-a022-723cc4a3a89b req-78adabe4-484f-4a81-848c-a084a6bad7bf service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7286410e-d9f9-42a1-a022-723cc4a3a89b req-78adabe4-484f-4a81-848c-a084a6bad7bf service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-7286410e-d9f9-42a1-a022-723cc4a3a89b req-78adabe4-484f-4a81-848c-a084a6bad7bf service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] No waiting events found dispatching network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:14:07 user nova-compute[72184]: WARNING nova.compute.manager [req-7286410e-d9f9-42a1-a022-723cc4a3a89b req-78adabe4-484f-4a81-848c-a084a6bad7bf service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received unexpected event network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 for instance with vm_state active and task_state None.
Aug 01 17:14:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-1ddb94a9-a592-458f-badd-b41e869f8141 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "c8822b9c-78cc-4cac-9549-26197a664abb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.118s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'info_cache' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:08 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance destroyed successfully.
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'resources' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap445659c5-55, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:14:08 user nova-compute[72184]: INFO os_vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55')
Aug 01 17:14:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:14:08 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc255781-6fb8-4eaa-8ae7-40ba364a4f83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a918721-3360-4e47-a321-88ed70f97814]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:08 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:08 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:08 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:08 user nova-compute[72184]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:08 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:08 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:08 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30279a7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f8204-531c-4609-81e7-8b3a3e5eb38b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec6b000-60f4-4623-8eb2-cb1dcac41b0d]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294942e-3a45-415a-b184-70a52644665c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f14422-0092-433e-a2e1-7b3edf4e3c90]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:14:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e781feae-1f57-4819-bb18-b6994630b506]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9203eb8-67e5-493e-b979-f0d31e138b20]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]
Aug 01 17:14:09 user nova-compute[72184]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bff58b-586c-41d6-b378-7ec397b804a2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== disconnect_volume: return (280ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start _get_guest_xml network_info=[{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '43f2de6d-0993-4b1f-bee3-efd7bbc96b33', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '48948157-6480-4c91-935d-37cd84a8b12c', 'attached_at': '', 'detached_at': '', 'volume_id': '4bec462e-de02-49ce-a8f3-8f0b4844a299', 'serial': '4bec462e-de02-49ce-a8f3-8f0b4844a299'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'numa_topology' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:14:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:14:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:14:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:14:09 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[111975d6-8c8a-48ab-a15f-23a7769e2608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:14:09 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d451e88-f164-44b3-8c8b-6ae8f84f7f71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299] added
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05da3ca9-aea1-483d-bb23-18ece489fa3e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8318f13-362c-4bad-94c6-5e2ae6ddc4aa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUfvAJSY {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUfvAJSY" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a68e68-bee7-4b62-9e52-540f3904ef1b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUfvAJSY'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d71e1d-8028-4749-bb45-028ef62f2054]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2ce63-39b5-4158-8e2f-397eef01bc1d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4612c1-550a-4c7c-a33c-71c9234cfbd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]
Aug 01 17:14:09 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3793ce8-b2a8-4b9f-b48e-4cb5e2269a31]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1a2bf4-1f41-4dff-b8e8-8db09c16e07b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df9538-322e-48a2-ac18-37561dc39a11]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:14:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26465653463366232', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465653463366232', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'pci_devices' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:14:10 user nova-compute[72184]:   <uuid>48948157-6480-4c91-935d-37cd84a8b12c</uuid>
Aug 01 17:14:10 user nova-compute[72184]:   <name>instance-00000025</name>
Aug 01 17:14:10 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:14:10 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:14:10 user nova-compute[72184]:   <metadata>
Aug 01 17:14:10 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:14:10 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:14:10 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeTestJSON-server-168633703</nova:name>
Aug 01 17:14:10 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:14:09</nova:creationTime>
Aug 01 17:14:10 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:14:10 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:14:10 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:14:10 user nova-compute[72184]:       <nova:owner>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:user uuid="6a5af08a5f7d46bdb7512360bcae3905">tempest-AttachVolumeTestJSON-984518084-project-member</nova:user>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:project uuid="88373a3db0cb453b99f922d0a1a31781">tempest-AttachVolumeTestJSON-984518084</nova:project>
Aug 01 17:14:10 user nova-compute[72184]:       </nova:owner>
Aug 01 17:14:10 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:14:10 user nova-compute[72184]:       <nova:ports>
Aug 01 17:14:10 user nova-compute[72184]:         <nova:port uuid="445659c5-5542-4629-9a26-80aca641662f">
Aug 01 17:14:10 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 17:14:10 user nova-compute[72184]:         </nova:port>
Aug 01 17:14:10 user nova-compute[72184]:       </nova:ports>
Aug 01 17:14:10 user nova-compute[72184]:     </nova:instance>
Aug 01 17:14:10 user nova-compute[72184]:   </metadata>
Aug 01 17:14:10 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:14:10 user nova-compute[72184]:     <system>
Aug 01 17:14:10 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:14:10 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:14:10 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:14:10 user nova-compute[72184]:       <entry name="serial">48948157-6480-4c91-935d-37cd84a8b12c</entry>
Aug 01 17:14:10 user nova-compute[72184]:       <entry name="uuid">48948157-6480-4c91-935d-37cd84a8b12c</entry>
Aug 01 17:14:10 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:14:10 user nova-compute[72184]:     </system>
Aug 01 17:14:10 user nova-compute[72184]:   </sysinfo>
Aug 01 17:14:10 user nova-compute[72184]:   <os>
Aug 01 17:14:10 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:14:10 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:14:10 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:14:10 user nova-compute[72184]:   </os>
Aug 01 17:14:10 user nova-compute[72184]:   <features>
Aug 01 17:14:10 user nova-compute[72184]:     <acpi/>
Aug 01 17:14:10 user nova-compute[72184]:     <apic/>
Aug 01 17:14:10 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:14:10 user nova-compute[72184]:   </features>
Aug 01 17:14:10 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:14:10 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:14:10 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:14:10 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:14:10 user nova-compute[72184]:   </clock>
Aug 01 17:14:10 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:14:10 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:14:10 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:14:10 user nova-compute[72184]:   </cpu>
Aug 01 17:14:10 user nova-compute[72184]:   <devices>
Aug 01 17:14:10 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:14:10 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:14:10 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk"/>
Aug 01 17:14:10 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:14:10 user nova-compute[72184]:     </disk>
Aug 01 17:14:10 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:14:10 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:14:10 user nova-compute[72184]:       <source dev="/dev/sdd"/>
Aug 01 17:14:10 user nova-compute[72184]:       <target dev="vdb" bus="virtio"/>
Aug 01 17:14:10 user nova-compute[72184]:       <serial>4bec462e-de02-49ce-a8f3-8f0b4844a299</serial>
Aug 01 17:14:10 user nova-compute[72184]:     </disk>
Aug 01 17:14:10 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:14:10 user nova-compute[72184]:       <mac address="fa:16:3e:4f:48:93"/>
Aug 01 17:14:10 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:14:10 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:14:10 user nova-compute[72184]:       <target dev="tap445659c5-55"/>
Aug 01 17:14:10 user nova-compute[72184]:     </interface>
Aug 01 17:14:10 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:14:10 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/console.log" append="off"/>
Aug 01 17:14:10 user nova-compute[72184]:     </serial>
Aug 01 17:14:10 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:14:10 user nova-compute[72184]:     <video>
Aug 01 17:14:10 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:14:10 user nova-compute[72184]:     </video>
Aug 01 17:14:10 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:14:10 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:14:10 user nova-compute[72184]:     </rng>
Aug 01 17:14:10 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:14:10 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:14:10 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:14:10 user nova-compute[72184]:     </memballoon>
Aug 01 17:14:10 user nova-compute[72184]:   </devices>
Aug 01 17:14:10 user nova-compute[72184]: </domain>
Aug 01 17:14:10 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Cannot resize image /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'migration_context' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG os_vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap445659c5-55, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap445659c5-55, col_values=(('external_ids', {'iface-id': '445659c5-5542-4629-9a26-80aca641662f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:48:93', 'vm-uuid': '48948157-6480-4c91-935d-37cd84a8b12c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:14:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:11 user nova-compute[72184]: INFO os_vif [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55')
Aug 01 17:14:12 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910037.1823533, 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:14:12 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] VM Stopped (Lifecycle Event)
Aug 01 17:14:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1c5e2eeb-bbfe-4cc6-8c89-87f525f2d2ea None None] [instance: 99df3b11-5b8e-4d64-bd50-fd9a4a7f821f] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-22938a75-ebca-4b92-b0b8-edf223a24862 req-52f18a65-5571-4230-928e-b8b142742a91 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-22938a75-ebca-4b92-b0b8-edf223a24862 req-52f18a65-5571-4230-928e-b8b142742a91 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-22938a75-ebca-4b92-b0b8-edf223a24862 req-52f18a65-5571-4230-928e-b8b142742a91 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-22938a75-ebca-4b92-b0b8-edf223a24862 req-52f18a65-5571-4230-928e-b8b142742a91 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG nova.compute.manager [req-22938a75-ebca-4b92-b0b8-edf223a24862 req-52f18a65-5571-4230-928e-b8b142742a91 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:14:12 user nova-compute[72184]: WARNING nova.compute.manager [req-22938a75-ebca-4b92-b0b8-edf223a24862 req-52f18a65-5571-4230-928e-b8b142742a91 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state stopped and task_state powering-on.
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:14:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910054.6929429, 48948157-6480-4c91-935d-37cd84a8b12c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:14:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Resumed (Lifecycle Event)
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:14:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance rebooted successfully.
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b3cb81ae-73a0-487b-90b0-dbfb7f0ee0e4 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-43cbc202-e22c-43b4-818c-14c52d83cbbf req-beebe9de-c368-4825-8605-d3044e06cbaf service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-43cbc202-e22c-43b4-818c-14c52d83cbbf req-beebe9de-c368-4825-8605-d3044e06cbaf service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-43cbc202-e22c-43b4-818c-14c52d83cbbf req-beebe9de-c368-4825-8605-d3044e06cbaf service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-43cbc202-e22c-43b4-818c-14c52d83cbbf req-beebe9de-c368-4825-8605-d3044e06cbaf service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-43cbc202-e22c-43b4-818c-14c52d83cbbf req-beebe9de-c368-4825-8605-d3044e06cbaf service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:14:14 user nova-compute[72184]: WARNING nova.compute.manager [req-43cbc202-e22c-43b4-818c-14c52d83cbbf req-beebe9de-c368-4825-8605-d3044e06cbaf service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state stopped and task_state powering-on.
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:14:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910054.6973214, 48948157-6480-4c91-935d-37cd84a8b12c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:14:14 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Started (Lifecycle Event)
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:14:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing instance network info cache due to event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updated VIF entry in instance network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:14:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5f51fd5d-7343-4910-a475-dab53d7cc79d req-7259919e-6447-49f4-9ae4-dddb8dff661b service nova] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:14:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:36 user nova-compute[72184]: INFO nova.compute.manager [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Shelving
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-158ea072-6597-4fb1-8726-5e61f7ba8c8f req-f990c4d9-83a7-4b15-8a06-756e952ef2f9 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-unplugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-158ea072-6597-4fb1-8726-5e61f7ba8c8f req-f990c4d9-83a7-4b15-8a06-756e952ef2f9 service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-158ea072-6597-4fb1-8726-5e61f7ba8c8f req-f990c4d9-83a7-4b15-8a06-756e952ef2f9 service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-158ea072-6597-4fb1-8726-5e61f7ba8c8f req-f990c4d9-83a7-4b15-8a06-756e952ef2f9 service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-158ea072-6597-4fb1-8726-5e61f7ba8c8f req-f990c4d9-83a7-4b15-8a06-756e952ef2f9 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-unplugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:14:36 user nova-compute[72184]: WARNING nova.compute.manager [req-158ea072-6597-4fb1-8726-5e61f7ba8c8f req-f990c4d9-83a7-4b15-8a06-756e952ef2f9 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-unplugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state active and task_state shelving.
Aug 01 17:14:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:36 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance destroyed successfully.
Aug 01 17:14:36 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Beginning cold snapshot process
Aug 01 17:14:37 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:14:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk /opt/stack/data/nova/instances/snapshots/tmp5zorx57v/e677b614c10f41388efa41278c418be7 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk /opt/stack/data/nova/instances/snapshots/tmp5zorx57v/e677b614c10f41388efa41278c418be7" returned: 0 in 0.630s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Snapshot extracted, beginning image upload
Aug 01 17:14:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-1fac1a61-8f6a-4329-bfd6-3e62bb98ddd1 req-0c406745-4ade-4b15-ba17-d111701222fd service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1fac1a61-8f6a-4329-bfd6-3e62bb98ddd1 req-0c406745-4ade-4b15-ba17-d111701222fd service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1fac1a61-8f6a-4329-bfd6-3e62bb98ddd1 req-0c406745-4ade-4b15-ba17-d111701222fd service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1fac1a61-8f6a-4329-bfd6-3e62bb98ddd1 req-0c406745-4ade-4b15-ba17-d111701222fd service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-1fac1a61-8f6a-4329-bfd6-3e62bb98ddd1 req-0c406745-4ade-4b15-ba17-d111701222fd service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:14:38 user nova-compute[72184]: WARNING nova.compute.manager [req-1fac1a61-8f6a-4329-bfd6-3e62bb98ddd1 req-0c406745-4ade-4b15-ba17-d111701222fd service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 17:14:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Snapshot image upload complete
Aug 01 17:14:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:39 user nova-compute[72184]: INFO nova.compute.manager [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Shelve offloading
Aug 01 17:14:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance destroyed successfully.
Aug 01 17:14:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:14:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:14:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:14:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:14:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:14:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance destroyed successfully.
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'resources' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1292560231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1292560231',id=40,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO67PZsPYZ8xmaJ30U8JUyLtBfAghfo/cD30xvMocfHHS8ijjAlFMx/CgPDCX/ajwRrpC+dJwwxYQwJpyS09ymzkamKC6EMhcFkLg6UtIf9w9baQKprKGmw9D2hC4CxGaQ==',key_name='tempest-keypair-239810973',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-e1qxq807',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member',shelved_at='2023-08-01T17:14:39.922243',shelved_host='user',shelved_image_id='d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=d1dd83d5-7a23-4ad2-878d-77a06c31d032,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG os_vif [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d434ee0-52, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing instance network info cache due to event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:14:41 user nova-compute[72184]: INFO os_vif [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52')
Aug 01 17:14:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Deleting instance files /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032_del
Aug 01 17:14:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Deletion of /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032_del complete
Aug 01 17:14:41 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Deleted allocations for instance d1dd83d5-7a23-4ad2-878d-77a06c31d032
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'numa_topology' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updated VIF entry in instance network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5d434ee0-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-75637518-13fd-42d0-a85a-35d1138a07d2 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.492s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0ec7b9ee-b9b2-4d04-99d6-fa5f75fb2f71 req-a003be2d-b0c3-4465-aabc-8de8bbb2d580 service nova] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:14:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:14:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:14:42 user nova-compute[72184]: INFO nova.compute.manager [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Detaching volume eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283
Aug 01 17:14:42 user nova-compute[72184]: INFO nova.virt.block_device [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Attempting to driver detach volume eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 from mountpoint /dev/vdb
Aug 01 17:14:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Attempting to detach device vdb from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:14:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:14:42 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:14:42 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:14:42 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:14:42 user nova-compute[72184]:   <serial>eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283</serial>
Aug 01 17:14:42 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:14:42 user nova-compute[72184]: </disk>
Aug 01 17:14:42 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:14:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Successfully detached device vdb from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the persistent domain config.
Aug 01 17:14:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:14:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:14:42 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:14:42 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:14:42 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:14:42 user nova-compute[72184]:   <serial>eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283</serial>
Aug 01 17:14:42 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:14:42 user nova-compute[72184]: </disk>
Aug 01 17:14:42 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910083.0149481, 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:14:43 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Successfully detached device vdb from instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 from the live domain config.
Aug 01 17:14:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nglybSjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:14:43 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b1418-76c8-4a36-ba51-3012d8785ffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd4266e-b19e-4b71-9fe9-22c5b912c6be]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:43 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:43 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:43 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:14:43 user nova-compute[72184]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 (non-flash)
Aug 01 17:14:43 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:14:43 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:14:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30277d1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[caafb000-a0a4-4969-b521-1d7ca60a743d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4862900f-56bf-44fc-88f6-44236b81bbab]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5031e2-162c-4cf1-a6e1-3a6c3b8c804c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38179d-098a-4f22-8e34-b491a5bae208]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6bcc9a-2012-42c3-828f-8ee72c729670]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2fa2a-8a4a-436e-ba84-3f5bd90aca0f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260]
Aug 01 17:14:43 user nova-compute[72184]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283, portal: 172.16.0.220,3260] successful.
Aug 01 17:14:43 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabe71bb-ea6b-4cb9-b74d-9a3bccdf1283 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fcaadb-dc39-40b4-adfb-dc956595a3a7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] <== disconnect_volume: return (272ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:14:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:14:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'flavor' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:14:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-aeed0e35-ebec-4230-88bf-9bac22d86499 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.556s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:14:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:51 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910076.8613558, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:14:51 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] VM Stopped (Lifecycle Event)
Aug 01 17:14:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-789cf68c-20c8-4abf-8d16-b1221c353a5c None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:14:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:14:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:14:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:02 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:15:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:15:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:15:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8300MB free_disk=25.288379669189453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0b618734-f7e5-4faf-96c8-43b4d8a45a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance c8822b9c-78cc-4cac-9549-26197a664abb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:15:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:15:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:15:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:15:09 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:15:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating instance_info_cache with network_info: [{"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:15:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-0f847a44-3dc0-42c8-bf2c-457aab2f47f2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:15:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:15:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:15:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:15:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:15:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:15:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:15:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:15:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:32 user nova-compute[72184]: INFO nova.compute.manager [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Terminating instance
Aug 01 17:15:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-d4c8b582-713e-4b64-a64c-933ef5872650 req-282b42a8-a156-4609-9e3f-faebba66c6e1 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-vif-unplugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d4c8b582-713e-4b64-a64c-933ef5872650 req-282b42a8-a156-4609-9e3f-faebba66c6e1 service nova] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d4c8b582-713e-4b64-a64c-933ef5872650 req-282b42a8-a156-4609-9e3f-faebba66c6e1 service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d4c8b582-713e-4b64-a64c-933ef5872650 req-282b42a8-a156-4609-9e3f-faebba66c6e1 service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-d4c8b582-713e-4b64-a64c-933ef5872650 req-282b42a8-a156-4609-9e3f-faebba66c6e1 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] No waiting events found dispatching network-vif-unplugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-d4c8b582-713e-4b64-a64c-933ef5872650 req-282b42a8-a156-4609-9e3f-faebba66c6e1 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-vif-unplugged-fc0db13b-b4b3-4395-949f-90dae118b6dd for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:15:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Instance destroyed successfully.
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lazy-loading 'resources' on Instance uuid 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1394141845',display_name='tempest-TestServerVolumeAttachmentScenario-server-1394141845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1394141845',id=38,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPZzYe3pxRlftgtOv8G+wKJjPu2MM2s5IjYKrLxG+Qm9pR8/Prp5qtUAHvqC4q4tv5VsFt6/DZfszjnPQpY85IIvGBA8ShYaGT0To/R58lfBphzMT/+sO8vCsFfA0jMBg==',key_name='tempest-keypair-1167773480',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4ae30149b894335808497b67db5c5b8',ramdisk_id='',reservation_id='r-50ld8xse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1259591507',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1259591507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5ba0dd45ab74761a449d968e13c3e7f',uuid=0f847a44-3dc0-42c8-bf2c-457aab2f47f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Converting VIF {"id": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "address": "fa:16:3e:f0:4c:69", "network": {"id": "fd3ad852-9b7a-4810-8a23-2691f740a7fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-19062238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4ae30149b894335808497b67db5c5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0db13b-b4", "ovs_interfaceid": "fc0db13b-b4b3-4395-949f-90dae118b6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG os_vif [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc0db13b-b4, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:15:33 user nova-compute[72184]: INFO os_vif [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:4c:69,bridge_name='br-int',has_traffic_filtering=True,id=fc0db13b-b4b3-4395-949f-90dae118b6dd,network=Network(fd3ad852-9b7a-4810-8a23-2691f740a7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0db13b-b4')
Aug 01 17:15:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Deleting instance files /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2_del
Aug 01 17:15:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Deletion of /opt/stack/data/nova/instances/0f847a44-3dc0-42c8-bf2c-457aab2f47f2_del complete
Aug 01 17:15:33 user nova-compute[72184]: INFO nova.compute.manager [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 17:15:33 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:15:33 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:15:34 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:15:34 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Took 1.21 seconds to deallocate network for instance.
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] Acquiring lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] No waiting events found dispatching network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:15:35 user nova-compute[72184]: WARNING nova.compute.manager [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received unexpected event network-vif-plugged-fc0db13b-b4b3-4395-949f-90dae118b6dd for instance with vm_state deleted and task_state None.
Aug 01 17:15:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-2dd63c60-ec18-4b62-bcfe-68567081c357 req-7937fdf2-66f8-4707-bad4-dd6010f66416 service nova] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Received event network-vif-deleted-fc0db13b-b4b3-4395-949f-90dae118b6dd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:35 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Deleted allocations for instance 0f847a44-3dc0-42c8-bf2c-457aab2f47f2
Aug 01 17:15:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7cedb6db-b0b1-4eea-9c24-041e2ddf8dc5 tempest-TestServerVolumeAttachmentScenario-1259591507 tempest-TestServerVolumeAttachmentScenario-1259591507-project-member] Lock "0f847a44-3dc0-42c8-bf2c-457aab2f47f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-changed-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Refreshing instance network info cache due to event network-changed-6c07f6af-3152-45bb-94c6-989def8aafe6. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] Acquiring lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] Acquired lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Refreshing network info cache for port 6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "c8822b9c-78cc-4cac-9549-26197a664abb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:39 user nova-compute[72184]: INFO nova.compute.manager [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Terminating instance
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updated VIF entry in instance network info cache for port 6c07f6af-3152-45bb-94c6-989def8aafe6. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updating instance_info_cache with network_info: [{"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6b3cf33c-58d7-4866-87ab-74538393f9b7 req-614609c3-eb1b-410b-b8dd-9a9577d79051 service nova] Releasing lock "refresh_cache-c8822b9c-78cc-4cac-9549-26197a664abb" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-7fe24837-9b00-4746-87ed-561c9c434d5f req-953d93aa-da08-4895-81cd-a063805e15c8 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-vif-unplugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7fe24837-9b00-4746-87ed-561c9c434d5f req-953d93aa-da08-4895-81cd-a063805e15c8 service nova] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7fe24837-9b00-4746-87ed-561c9c434d5f req-953d93aa-da08-4895-81cd-a063805e15c8 service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7fe24837-9b00-4746-87ed-561c9c434d5f req-953d93aa-da08-4895-81cd-a063805e15c8 service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-7fe24837-9b00-4746-87ed-561c9c434d5f req-953d93aa-da08-4895-81cd-a063805e15c8 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] No waiting events found dispatching network-vif-unplugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-7fe24837-9b00-4746-87ed-561c9c434d5f req-953d93aa-da08-4895-81cd-a063805e15c8 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-vif-unplugged-6c07f6af-3152-45bb-94c6-989def8aafe6 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Instance destroyed successfully.
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.objects.instance [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'resources' on Instance uuid c8822b9c-78cc-4cac-9549-26197a664abb {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-637784130',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-637784130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-637784130',id=41,image_ref='b473fcbc-2394-4bd0-92c0-701c9758dde8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAuL3QKBQ3pd5dPkoWTrpFBp6y5hLVuKUI3S0SmYqjPTW2SoVjq863Vhkcw5T3iqk8V2dshYJDnnR2o+7IdyjIeJ4Jcu7XHEXYCAmHKbLv/t90uKTiicnOCpJm39rVVng==',key_name='tempest-keypair-273005031',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-idv6tsmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1490009883',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce144879b7e4638822f0d7174693575',uuid=c8822b9c-78cc-4cac-9549-26197a664abb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "6c07f6af-3152-45bb-94c6-989def8aafe6", "address": "fa:16:3e:d0:32:fd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c07f6af-31", "ovs_interfaceid": "6c07f6af-3152-45bb-94c6-989def8aafe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_vif [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c07f6af-31, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:15:40 user nova-compute[72184]: INFO os_vif [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:32:fd,bridge_name='br-int',has_traffic_filtering=True,id=6c07f6af-3152-45bb-94c6-989def8aafe6,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c07f6af-31')
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPJBYqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:15:40 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb593d-7a7f-4f6e-a5f5-de32ce6f8ac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b2575d-d404-4ec0-8b79-9be40a28aac2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:15:40 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:15:40 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:15:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:15:40 user nova-compute[72184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 (non-flash)
Aug 01 17:15:40 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:15:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301830e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994'): ({'sde'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Removing single pathed devices sde {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a41ea5-d556-4af2-b98d-99b68d712400]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ebfb7a-2b2f-4fda-bbe9-26745459a223]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flushing IO for device /dev/sde {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[005c50e1-fc56-4348-b347-c6bc0e0ff21d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a05b6b7-8634-4fb1-bc2f-fa51cc549d38]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO60424bd-dc6613cfedf49fe4', '/dev/disk/by-id/scsi-26463363631336366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_60424bd') {{(pid=83397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9d97ad-db8b-4f59-9a8f-39481a0b3c36]: (4, None) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58b796e-7850-4f86-903d-98c075641cf3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce863d-eb35-4d34-9b75-0021731d2312]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260]
Aug 01 17:15:40 user nova-compute[72184]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994, portal: 172.16.0.220,3260] successful.
Aug 01 17:15:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b78e7f0-17cc-4286-81bd-cd304335c994 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bb4f14-51b5-412b-a1b7-0241b3d03ea0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== disconnect_volume: return (284ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:15:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Deleting instance files /opt/stack/data/nova/instances/c8822b9c-78cc-4cac-9549-26197a664abb_del
Aug 01 17:15:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Deletion of /opt/stack/data/nova/instances/c8822b9c-78cc-4cac-9549-26197a664abb_del complete
Aug 01 17:15:40 user nova-compute[72184]: INFO nova.compute.manager [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 17:15:40 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:15:40 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:15:41 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Took 0.94 seconds to deallocate network for instance.
Aug 01 17:15:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-ff3c4897-b8a5-4bd6-bef2-fc12135630bf req-f089893a-9557-4ed9-a2c2-b223ee04c481 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-vif-deleted-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:41 user nova-compute[72184]: INFO nova.compute.manager [req-ff3c4897-b8a5-4bd6-bef2-fc12135630bf req-f089893a-9557-4ed9-a2c2-b223ee04c481 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Neutron deleted interface 6c07f6af-3152-45bb-94c6-989def8aafe6; detaching it from the instance and deleting it from the info cache
Aug 01 17:15:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-ff3c4897-b8a5-4bd6-bef2-fc12135630bf req-f089893a-9557-4ed9-a2c2-b223ee04c481 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-ff3c4897-b8a5-4bd6-bef2-fc12135630bf req-f089893a-9557-4ed9-a2c2-b223ee04c481 service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Detach interface failed, port_id=6c07f6af-3152-45bb-94c6-989def8aafe6, reason: Instance c8822b9c-78cc-4cac-9549-26197a664abb could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-5ae545d0-1a90-42c4-9880-35d1133d7d6a req-5e82f7e9-a62e-49a6-b042-e624cd1aae4d service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received event network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5ae545d0-1a90-42c4-9880-35d1133d7d6a req-5e82f7e9-a62e-49a6-b042-e624cd1aae4d service nova] Acquiring lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5ae545d0-1a90-42c4-9880-35d1133d7d6a req-5e82f7e9-a62e-49a6-b042-e624cd1aae4d service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5ae545d0-1a90-42c4-9880-35d1133d7d6a req-5e82f7e9-a62e-49a6-b042-e624cd1aae4d service nova] Lock "c8822b9c-78cc-4cac-9549-26197a664abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-5ae545d0-1a90-42c4-9880-35d1133d7d6a req-5e82f7e9-a62e-49a6-b042-e624cd1aae4d service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] No waiting events found dispatching network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:15:41 user nova-compute[72184]: WARNING nova.compute.manager [req-5ae545d0-1a90-42c4-9880-35d1133d7d6a req-5e82f7e9-a62e-49a6-b042-e624cd1aae4d service nova] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Received unexpected event network-vif-plugged-6c07f6af-3152-45bb-94c6-989def8aafe6 for instance with vm_state active and task_state deleting.
Aug 01 17:15:42 user nova-compute[72184]: INFO nova.compute.manager [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Took 0.75 seconds to detach 1 volumes for instance.
Aug 01 17:15:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Deleting volume: 7b78e7f0-17cc-4286-81bd-cd304335c994 {{(pid=72184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 17:15:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:42 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:15:42 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:15:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:42 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Deleted allocations for instance c8822b9c-78cc-4cac-9549-26197a664abb
Aug 01 17:15:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-d4a41e46-51f6-4041-8d6c-d8c2bf7d9518 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "c8822b9c-78cc-4cac-9549-26197a664abb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:15:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:48 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910133.6390398, 0f847a44-3dc0-42c8-bf2c-457aab2f47f2 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:15:48 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] VM Stopped (Lifecycle Event)
Aug 01 17:15:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-5da3af09-29ca-48a6-9cbd-039cb91969ae None None] [instance: 0f847a44-3dc0-42c8-bf2c-457aab2f47f2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:15:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910140.3370626, c8822b9c-78cc-4cac-9549-26197a664abb => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:15:55 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] VM Stopped (Lifecycle Event)
Aug 01 17:15:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-794584b6-1c6e-4989-89e6-ba0c02c6d188 None None] [instance: c8822b9c-78cc-4cac-9549-26197a664abb] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:15:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:15:59 user nova-compute[72184]: INFO nova.compute.manager [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Detaching volume 4bec462e-de02-49ce-a8f3-8f0b4844a299
Aug 01 17:15:59 user nova-compute[72184]: INFO nova.virt.block_device [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Attempting to driver detach volume 4bec462e-de02-49ce-a8f3-8f0b4844a299 from mountpoint /dev/vdb
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Attempting to detach device vdb from instance 48948157-6480-4c91-935d-37cd84a8b12c from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:15:59 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:15:59 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:15:59 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:15:59 user nova-compute[72184]:   <serial>4bec462e-de02-49ce-a8f3-8f0b4844a299</serial>
Aug 01 17:15:59 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:15:59 user nova-compute[72184]: </disk>
Aug 01 17:15:59 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:15:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully detached device vdb from instance 48948157-6480-4c91-935d-37cd84a8b12c from the persistent domain config.
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48948157-6480-4c91-935d-37cd84a8b12c from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:15:59 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:15:59 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:15:59 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:15:59 user nova-compute[72184]:   <serial>4bec462e-de02-49ce-a8f3-8f0b4844a299</serial>
Aug 01 17:15:59 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:15:59 user nova-compute[72184]: </disk>
Aug 01 17:15:59 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910159.790582, 48948157-6480-4c91-935d-37cd84a8b12c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:15:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully detached device vdb from instance 48948157-6480-4c91-935d-37cd84a8b12c from the live domain config.
Aug 01 17:15:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUfvAJSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:15:59 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bb39f7-ef31-4450-b3f9-87812b491ac2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b24a4a7-d23e-4fec-b226-c85af2bc892c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:15:59 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:15:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:15:59 user nova-compute[72184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 (non-flash)
Aug 01 17:15:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff86964d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c625c60-f056-4c07-a355-777e77d98461]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2dd1ad-3491-4d98-bca7-ceae377008fb]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadaf2f9-84f6-40f0-b65f-1ff638fd0888]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:15:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.152s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d961fd-a788-4d29-9e6a-d42f224251b9]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6581e6-69bd-40ec-a3ef-f9bbc7ca403b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e2e5b0-652a-493f-a96f-50ed49afe006]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260]
Aug 01 17:16:00 user nova-compute[72184]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299, portal: 172.16.0.220,3260] successful.
Aug 01 17:16:00 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bec462e-de02-49ce-a8f3-8f0b4844a299 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb582e4-7355-4fd5-a1b3-eb6f3029fc92]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== disconnect_volume: return (365ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b409b997-4c7f-418e-9a16-420209ca7f5b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.607s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72184) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-60d3294a-5587-42dc-aa24-67b7f903f351 req-cbf5d17d-1a5f-4140-a7a2-0adffa84e010 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60d3294a-5587-42dc-aa24-67b7f903f351 req-cbf5d17d-1a5f-4140-a7a2-0adffa84e010 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60d3294a-5587-42dc-aa24-67b7f903f351 req-cbf5d17d-1a5f-4140-a7a2-0adffa84e010 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-60d3294a-5587-42dc-aa24-67b7f903f351 req-cbf5d17d-1a5f-4140-a7a2-0adffa84e010 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-60d3294a-5587-42dc-aa24-67b7f903f351 req-cbf5d17d-1a5f-4140-a7a2-0adffa84e010 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:01 user nova-compute[72184]: WARNING nova.compute.manager [req-60d3294a-5587-42dc-aa24-67b7f903f351 req-cbf5d17d-1a5f-4140-a7a2-0adffa84e010 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state active and task_state powering-off.
Aug 01 17:16:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance destroyed successfully.
Aug 01 17:16:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0deb0b64-b740-4215-bd30-ed3b9684a16b tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.916s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9c36e28-4968-4796-aa61-a6f785260108 req-c5cf4609-095c-4362-ac82-21200b0769ed service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9c36e28-4968-4796-aa61-a6f785260108 req-c5cf4609-095c-4362-ac82-21200b0769ed service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9c36e28-4968-4796-aa61-a6f785260108 req-c5cf4609-095c-4362-ac82-21200b0769ed service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9c36e28-4968-4796-aa61-a6f785260108 req-c5cf4609-095c-4362-ac82-21200b0769ed service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9c36e28-4968-4796-aa61-a6f785260108 req-c5cf4609-095c-4362-ac82-21200b0769ed service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:04 user nova-compute[72184]: WARNING nova.compute.manager [req-d9c36e28-4968-4796-aa61-a6f785260108 req-c5cf4609-095c-4362-ac82-21200b0769ed service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state stopped and task_state None.
Aug 01 17:16:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:16:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:16:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.313663482666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 0b618734-f7e5-4faf-96c8-43b4d8a45a13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:16:05 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:16:06 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:16:06 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:16:06 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:16:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updating instance_info_cache with network_info: [{"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-0b618734-f7e5-4faf-96c8-43b4d8a45a13" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:16:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:16:17 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910162.4176676, 48948157-6480-4c91-935d-37cd84a8b12c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:16:17 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Stopped (Lifecycle Event)
Aug 01 17:16:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-437f5592-e555-40c6-9e9a-357e1c20a6b0 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-437f5592-e555-40c6-9e9a-357e1c20a6b0 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:16:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:28 user nova-compute[72184]: INFO nova.compute.manager [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Unshelving
Aug 01 17:16:28 user nova-compute[72184]: INFO nova.virt.block_device [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Booting with volume 6c500cf4-6efc-4376-9c74-849fe732d9f5 at /dev/vdc
Aug 01 17:16:28 user nova-compute[72184]: DEBUG os_brick.utils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd9513-ce41-436f-8cbb-919f79adf0be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad46c50-630d-4cac-b4b9-8a3d079639d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f784f51a-e783-43de-8d9e-f1a394b1c99d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efdf9bd-8a88-4e95-a228-d2f7684bd03f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:16:29 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:16:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d49647-3a6b-4347-92d1-ef7d6cdc2ebc]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG os_brick.utils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:16:29 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating existing volume attachment record: d7042945-c2ec-4b27-8447-d6f5a865bfe3 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:16:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:33 user nova-compute[72184]: INFO nova.compute.manager [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Terminating instance
Aug 01 17:16:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-f666869a-7249-4d77-99ca-53e5752ab735 req-fe4a6c83-b652-476d-81d7-6bb9e3669e45 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-unplugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f666869a-7249-4d77-99ca-53e5752ab735 req-fe4a6c83-b652-476d-81d7-6bb9e3669e45 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f666869a-7249-4d77-99ca-53e5752ab735 req-fe4a6c83-b652-476d-81d7-6bb9e3669e45 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f666869a-7249-4d77-99ca-53e5752ab735 req-fe4a6c83-b652-476d-81d7-6bb9e3669e45 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-f666869a-7249-4d77-99ca-53e5752ab735 req-fe4a6c83-b652-476d-81d7-6bb9e3669e45 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-unplugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-f666869a-7249-4d77-99ca-53e5752ab735 req-fe4a6c83-b652-476d-81d7-6bb9e3669e45 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-unplugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:16:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Instance destroyed successfully.
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'resources' on Instance uuid 0b618734-f7e5-4faf-96c8-43b4d8a45a13 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-162498531',display_name='tempest-TestVolumeBootPattern-volume-backed-server-162498531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-162498531',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAurSUqiHpftaSRhXnMtQii5p+WblvMC3XbNBx3nzCB5+KFTZbwBhaMfuSOKwR4vqe0Cc0/xq/ymz/a1bE+23U2DtQL70e9fYyyz+7+cLVZKDSFnwBcdAw1Bwdx1ubjuEg==',key_name='tempest-keypair-705488717',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:12:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-nf901oa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce144879b7e4638822f0d7174693575',uuid=0b618734-f7e5-4faf-96c8-43b4d8a45a13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "address": "fa:16:3e:1f:d0:cd", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6caefbf-22", "ovs_interfaceid": "f6caefbf-2287-407b-bf3f-8e6e401e709f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_vif [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6caefbf-22, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: INFO os_vif [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d0:cd,bridge_name='br-int',has_traffic_filtering=True,id=f6caefbf-2287-407b-bf3f-8e6e401e709f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6caefbf-22')
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDIwGKVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:16:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4789ea-251b-4808-a187-d1d21af30ee9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53fbf53-dc68-4e22-9d0a-7906da826c86]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:16:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e (non-flash)
Aug 01 17:16:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30277d0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[665764b7-4c14-4705-846e-6336fed1eb4a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67a16e-bfae-4ec5-8839-5403f2195016]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2341c16a-1ea6-4485-84c9-0449bc061b65]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d416083-9be2-4a59-835d-bd771cba7147]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f01b30-8a9b-4bff-94de-833fe28576d6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e65991-d621-4fb9-bb0f-1d442bbd037d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260]
Aug 01 17:16:34 user nova-compute[72184]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e, portal: 172.16.0.220,3260] successful.
Aug 01 17:16:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:026ac40b-af20-451b-ba01-87cac3bcf75e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8dcffa-566e-477d-9fd5-5d1ae06f9a03]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== disconnect_volume: return (391ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:16:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Deleting instance files /opt/stack/data/nova/instances/0b618734-f7e5-4faf-96c8-43b4d8a45a13_del
Aug 01 17:16:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Deletion of /opt/stack/data/nova/instances/0b618734-f7e5-4faf-96c8-43b4d8a45a13_del complete
Aug 01 17:16:34 user nova-compute[72184]: INFO nova.compute.manager [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 01 17:16:34 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:35 user nova-compute[72184]: WARNING nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received unexpected event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with vm_state active and task_state deleting.
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:35 user nova-compute[72184]: WARNING nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received unexpected event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with vm_state active and task_state deleting.
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:35 user nova-compute[72184]: WARNING nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received unexpected event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with vm_state active and task_state deleting.
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-unplugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-unplugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-unplugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Acquiring lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] No waiting events found dispatching network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:35 user nova-compute[72184]: WARNING nova.compute.manager [req-4cc1219f-22d7-4f39-a3df-4e3c744b1719 req-3d21059e-63d8-4c13-8fce-70484fec8d10 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received unexpected event network-vif-plugged-f6caefbf-2287-407b-bf3f-8e6e401e709f for instance with vm_state active and task_state deleting.
Aug 01 17:16:35 user nova-compute[72184]: DEBUG nova.compute.manager [req-df2ea432-9f1c-47d3-ba2f-9fd1b7cad9b5 req-5187b775-0e76-40b6-8f97-f4e9292b99e0 service nova] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Received event network-vif-deleted-f6caefbf-2287-407b-bf3f-8e6e401e709f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:35 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Took 1.21 seconds to deallocate network for instance.
Aug 01 17:16:36 user nova-compute[72184]: INFO nova.compute.manager [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Took 0.80 seconds to detach 1 volumes for instance.
Aug 01 17:16:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Deleting volume: 026ac40b-af20-451b-ba01-87cac3bcf75e {{(pid=72184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 17:16:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:36 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:16:36 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:16:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:37 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Deleted allocations for instance 0b618734-f7e5-4faf-96c8-43b4d8a45a13
Aug 01 17:16:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-42e6e10f-bab6-4ee4-a8cc-2def1a9d4627 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "0b618734-f7e5-4faf-96c8-43b4d8a45a13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.869s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'pci_requests' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'numa_topology' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:16:45 user nova-compute[72184]: INFO nova.compute.claims [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Claim successful on node user
Aug 01 17:16:45 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:16:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:45 user nova-compute[72184]: INFO nova.network.neutron [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating port 5d434ee0-529b-4df1-a3de-88abd908cd8a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 17:16:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:16:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:16:46 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:16:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing instance network info cache due to event network-changed-5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:16:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG nova.network.neutron [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:16:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Creating image(s)
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG nova.network.neutron [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Refreshing network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "f790b0067124c7d28e8ee6abdeb07db57642c5df" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "f790b0067124c7d28e8ee6abdeb07db57642c5df" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.part --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG nova.virt.images [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5 was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.part /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updated VIF entry in instance network info cache for port 5d434ee0-529b-4df1-a3de-88abd908cd8a. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:16:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d9a24543-6922-4b0a-9f20-6d44a34e8e8b req-d5bd4ef5-8b5c-494a-8f4b-358d6301dd3a service nova] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910194.0235293, 0b618734-f7e5-4faf-96c8-43b4d8a45a13 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:16:49 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] VM Stopped (Lifecycle Event)
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.part /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.converted" returned: 0 in 0.590s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-6a83b069-1725-4550-ad47-dfc12fea630f None None] [instance: 0b618734-f7e5-4faf-96c8-43b4d8a45a13] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "f790b0067124c7d28e8ee6abdeb07db57642c5df" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.933s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "f790b0067124c7d28e8ee6abdeb07db57642c5df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "f790b0067124c7d28e8ee6abdeb07db57642c5df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df,backing_fmt=raw /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df,backing_fmt=raw /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk 1073741824" returned: 0 in 0.055s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "f790b0067124c7d28e8ee6abdeb07db57642c5df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'migration_context' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Rebasing disk image.
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:49 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 -F raw /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 -F raw /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk" returned: 0 in 2.616s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Ensure instance console log exists: /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Start _get_guest_xml network_info=[{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='bd718cb5f759c837868345167402c032',container_format='bare',created_at=2023-08-01T17:14:36Z,direct_url=<?>,disk_format='qcow2',id=d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1292560231-shelved',owner='77fc1bb5f955400196d88dbc81346bb5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T17:14:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd7042945-c2ec-4b27-8447-d6f5a865bfe3', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBvLhdtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd1dd83d5-7a23-4ad2-878d-77a06c31d032', 'attached_at': '', 'detached_at': '', 'volume_id': '6c500cf4-6efc-4376-9c74-849fe732d9f5', 'serial': '6c500cf4-6efc-4376-9c74-849fe732d9f5'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:16:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:16:52 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bd718cb5f759c837868345167402c032',container_format='bare',created_at=2023-08-01T17:14:36Z,direct_url=<?>,disk_format='qcow2',id=d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1292560231-shelved',owner='77fc1bb5f955400196d88dbc81346bb5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T17:14:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBvLhdtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:16:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:16:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:16:52 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260" returned: 21 in 0.067s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c8f5a9-2942-4e03-85de-465bd7768518]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:16:52 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.085s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[892beb09-2ff3-476b-8d54-c34ab5d48fa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5] added
Aug 01 17:16:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463878e-5290-43db-a0d9-7a861849e85d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74b96b-d098-40bb-b8c3-bb0ef89da12d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBvLhdtN {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBvLhdtN" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3db6184-8797-46ed-beb3-1bf47821c843]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBvLhdtN'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[003b28eb-7ca4-4afe-a0ab-fdb58b8a7916]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d574dd4-04e8-4a6c-a422-849e75ebb035]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:16:52 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:16:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:16:52 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:16:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:16:52 user nova-compute[72184]: 
Aug 01 17:16:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[979fbb13-bce5-4e7b-84f2-eded97451963]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260]
Aug 01 17:16:53 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260] successful.
Aug 01 17:16:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd8bc4-62ae-41dd-8d07-513c33c66c81]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6ffe2-8904-4ade-bf4a-62b0110e8545]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:16:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:16:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29565d2-c278-453c-ac84-deee95255e4b]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBvLhdtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:16:53 user nova-compute[72184]: INFO nova.compute.claims [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Claim successful on node user
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:16:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:16:53 user nova-compute[72184]: INFO nova.virt.block_device [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Booting with volume eaa0d8a0-7b05-472d-a489-88a893fb7bd3 at /dev/vda
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.policy [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4174219695504fc4bae42cb9c2aff01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e54f115ee4626a138b42169a64b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.utils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c85b2-ddf7-403e-9dfd-724564738e97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46462f-19e6-4300-9e23-2f37b107d5dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0092ce9-1a5d-4d73-a222-5f03a3aa1179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ebbe4-c7ed-46fe-a6c4-f77372d8e85b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:16:53 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:16:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[081df94f-b715-42c8-8470-7141a78c5361]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG os_brick.utils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:16:53 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating existing volume attachment record: 0c651736-f3f1-4a45-95c0-2a3fd45a0ccf {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26638363961613564', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638363961613564', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1292560231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1292560231',id=40,image_ref='d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-239810973',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-e1qxq807',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member',shelved_at='2023-08-01T17:14:39.922243',shelved_host='user',shelved_image_id='d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=d1dd83d5-7a23-4ad2-878d-77a06c31d032,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'pci_devices' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:16:54 user nova-compute[72184]:   <uuid>d1dd83d5-7a23-4ad2-878d-77a06c31d032</uuid>
Aug 01 17:16:54 user nova-compute[72184]:   <name>instance-00000028</name>
Aug 01 17:16:54 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:16:54 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:16:54 user nova-compute[72184]:   <metadata>
Aug 01 17:16:54 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:16:54 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:16:54 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1292560231</nova:name>
Aug 01 17:16:54 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:16:52</nova:creationTime>
Aug 01 17:16:54 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:16:54 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:16:54 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:16:54 user nova-compute[72184]:       <nova:owner>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:user uuid="80fcd66a964e435e9b6494c67e6a9c14">tempest-AttachVolumeShelveTestJSON-1405411677-project-member</nova:user>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:project uuid="77fc1bb5f955400196d88dbc81346bb5">tempest-AttachVolumeShelveTestJSON-1405411677</nova:project>
Aug 01 17:16:54 user nova-compute[72184]:       </nova:owner>
Aug 01 17:16:54 user nova-compute[72184]:       <nova:root type="image" uuid="d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5"/>
Aug 01 17:16:54 user nova-compute[72184]:       <nova:ports>
Aug 01 17:16:54 user nova-compute[72184]:         <nova:port uuid="5d434ee0-529b-4df1-a3de-88abd908cd8a">
Aug 01 17:16:54 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:16:54 user nova-compute[72184]:         </nova:port>
Aug 01 17:16:54 user nova-compute[72184]:       </nova:ports>
Aug 01 17:16:54 user nova-compute[72184]:     </nova:instance>
Aug 01 17:16:54 user nova-compute[72184]:   </metadata>
Aug 01 17:16:54 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:16:54 user nova-compute[72184]:     <system>
Aug 01 17:16:54 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:16:54 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:16:54 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:16:54 user nova-compute[72184]:       <entry name="serial">d1dd83d5-7a23-4ad2-878d-77a06c31d032</entry>
Aug 01 17:16:54 user nova-compute[72184]:       <entry name="uuid">d1dd83d5-7a23-4ad2-878d-77a06c31d032</entry>
Aug 01 17:16:54 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:16:54 user nova-compute[72184]:     </system>
Aug 01 17:16:54 user nova-compute[72184]:   </sysinfo>
Aug 01 17:16:54 user nova-compute[72184]:   <os>
Aug 01 17:16:54 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:16:54 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:16:54 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:16:54 user nova-compute[72184]:   </os>
Aug 01 17:16:54 user nova-compute[72184]:   <features>
Aug 01 17:16:54 user nova-compute[72184]:     <acpi/>
Aug 01 17:16:54 user nova-compute[72184]:     <apic/>
Aug 01 17:16:54 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:16:54 user nova-compute[72184]:   </features>
Aug 01 17:16:54 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:16:54 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:16:54 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:16:54 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:16:54 user nova-compute[72184]:   </clock>
Aug 01 17:16:54 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:16:54 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:16:54 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:16:54 user nova-compute[72184]:   </cpu>
Aug 01 17:16:54 user nova-compute[72184]:   <devices>
Aug 01 17:16:54 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:16:54 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:16:54 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk"/>
Aug 01 17:16:54 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:16:54 user nova-compute[72184]:     </disk>
Aug 01 17:16:54 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:16:54 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:16:54 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 17:16:54 user nova-compute[72184]:       <target dev="vdc" bus="virtio"/>
Aug 01 17:16:54 user nova-compute[72184]:       <serial>6c500cf4-6efc-4376-9c74-849fe732d9f5</serial>
Aug 01 17:16:54 user nova-compute[72184]:     </disk>
Aug 01 17:16:54 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:16:54 user nova-compute[72184]:       <mac address="fa:16:3e:3e:9d:2f"/>
Aug 01 17:16:54 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:16:54 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:16:54 user nova-compute[72184]:       <target dev="tap5d434ee0-52"/>
Aug 01 17:16:54 user nova-compute[72184]:     </interface>
Aug 01 17:16:54 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:16:54 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/console.log" append="off"/>
Aug 01 17:16:54 user nova-compute[72184]:     </serial>
Aug 01 17:16:54 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:16:54 user nova-compute[72184]:     <video>
Aug 01 17:16:54 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:16:54 user nova-compute[72184]:     </video>
Aug 01 17:16:54 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:16:54 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:16:54 user nova-compute[72184]:     </rng>
Aug 01 17:16:54 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:16:54 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:16:54 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:16:54 user nova-compute[72184]:     </memballoon>
Aug 01 17:16:54 user nova-compute[72184]:   </devices>
Aug 01 17:16:54 user nova-compute[72184]: </domain>
Aug 01 17:16:54 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1292560231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1292560231',id=40,image_ref='d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-239810973',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-e1qxq807',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member',shelved_at='2023-08-01T17:14:39.922243',shelved_host='user',shelved_image_id='d6c1454e-b7b3-4b0f-937c-2fbd53bbe1e5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=d1dd83d5-7a23-4ad2-878d-77a06c31d032,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG os_vif [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d434ee0-52, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d434ee0-52, col_values=(('external_ids', {'iface-id': '5d434ee0-529b-4df1-a3de-88abd908cd8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9d:2f', 'vm-uuid': 'd1dd83d5-7a23-4ad2-878d-77a06c31d032'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:54 user nova-compute[72184]: INFO os_vif [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52')
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No VIF found with MAC fa:16:3e:3e:9d:2f, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:16:54 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Successfully created port: 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:16:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-0d994b26-935f-454f-a29f-c00ccbd8d7b0 req-52a4387f-2c6b-4479-ae70-27c1fbffbe9f service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0d994b26-935f-454f-a29f-c00ccbd8d7b0 req-52a4387f-2c6b-4479-ae70-27c1fbffbe9f service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0d994b26-935f-454f-a29f-c00ccbd8d7b0 req-52a4387f-2c6b-4479-ae70-27c1fbffbe9f service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0d994b26-935f-454f-a29f-c00ccbd8d7b0 req-52a4387f-2c6b-4479-ae70-27c1fbffbe9f service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-0d994b26-935f-454f-a29f-c00ccbd8d7b0 req-52a4387f-2c6b-4479-ae70-27c1fbffbe9f service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:56 user nova-compute[72184]: WARNING nova.compute.manager [req-0d994b26-935f-454f-a29f-c00ccbd8d7b0 req-52a4387f-2c6b-4479-ae70-27c1fbffbe9f service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Successfully updated port: 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.compute.manager [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing instance network info cache due to event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.network.neutron [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance network_info: |[{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:16:56 user nova-compute[72184]: DEBUG nova.network.neutron [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:16:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updated VIF entry in instance network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:16:57 user nova-compute[72184]: DEBUG nova.network.neutron [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:16:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-1c7f6f60-fa51-4c26-be5d-a39f5add2ed4 req-1d74e08e-eec8-4002-9e6e-111250519fac service nova] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-3aad2cab-a921-4144-927f-fcdb91bea948 req-53c02951-3333-4de8-9e6b-de507781c07b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3aad2cab-a921-4144-927f-fcdb91bea948 req-53c02951-3333-4de8-9e6b-de507781c07b service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3aad2cab-a921-4144-927f-fcdb91bea948 req-53c02951-3333-4de8-9e6b-de507781c07b service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3aad2cab-a921-4144-927f-fcdb91bea948 req-53c02951-3333-4de8-9e6b-de507781c07b service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [req-3aad2cab-a921-4144-927f-fcdb91bea948 req-53c02951-3333-4de8-9e6b-de507781c07b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:16:58 user nova-compute[72184]: WARNING nova.compute.manager [req-3aad2cab-a921-4144-927f-fcdb91bea948 req-53c02951-3333-4de8-9e6b-de507781c07b service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910218.54278, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:16:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] VM Resumed (Lifecycle Event)
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:16:58 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance spawned successfully.
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:16:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910218.5474555, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:16:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] VM Started (Lifecycle Event)
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:16:58 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:16:58 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:16:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8971887-7319-4a54-83ef-ff7d266746a1 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.184s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:16:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:16:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:17:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Creating image(s)
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Ensure instance console log exists: /opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Start _get_guest_xml network_info=[{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '0c651736-f3f1-4a45-95c0-2a3fd45a0ccf', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7d35dee-22ac-440b-8a9e-994831bbc55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaa0d8a0-7b05-472d-a489-88a893fb7bd3', 'serial': 'eaa0d8a0-7b05-472d-a489-88a893fb7bd3'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:17:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:02 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:17:02 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:17:02 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:17:02 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e930611f-0a8e-4f77-b92e-0a1bd3b5d4f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:17:02 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce1e76d-ea71-4f0b-bc28-68c55f17cb82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3] added
Aug 01 17:17:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db21bff-6fed-44e8-9552-cd0d0a223f72]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3fd5a5-c43d-44b5-828d-f5a0f25ac2a6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsgBikFP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsgBikFP" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[180f01f9-25dc-4d3a-aa80-1585b9f9ec6c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsgBikFP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc96dbc-2d46-4ce0-8062-04685dae1a70]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82344e64-b47e-4ae2-94da-36c7fbc5bfd0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee6f08a-2988-4778-aedf-af59a665cc37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]
Aug 01 17:17:02 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.
Aug 01 17:17:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57382f8-c36c-4ff8-8ea8-5784586ed15f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd82b40-2c35-48aa-88a6-e1e45be02ebf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:02 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:17:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:02 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:17:02 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[002cb139-9b60-4c77-a938-6069aae0fe33]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:17:02 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23261366532316435', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366532316435', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1057693331',display_name='tempest-TestShelveInstance-server-1057693331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1057693331',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYIBxkH1dfoBtkKcc+ujWV85mfifnLhQYJBWksWsovla7FlpasFj0E2UptyY4dj5F1LZWxhbmFwb1BALqN/KV70bJXwIRY1T2KhQ01diFBoJ9Ow9HEu9ujXf+zfICsRzw==',key_name='tempest-TestShelveInstance-811487968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e27e54f115ee4626a138b42169a64b31',ramdisk_id='',reservation_id='r-c94jav0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-892605189',owner_user_name='tempest-TestShelveInstance-892605189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:16:54Z,user_data=None,user_id='4174219695504fc4bae42cb9c2aff01d',uuid=c7d35dee-22ac-440b-8a9e-994831bbc55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converting VIF {"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'pci_devices' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:17:03 user nova-compute[72184]:   <uuid>c7d35dee-22ac-440b-8a9e-994831bbc55c</uuid>
Aug 01 17:17:03 user nova-compute[72184]:   <name>instance-0000002a</name>
Aug 01 17:17:03 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:17:03 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:17:03 user nova-compute[72184]:   <metadata>
Aug 01 17:17:03 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:17:03 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:17:03 user nova-compute[72184]:       <nova:name>tempest-TestShelveInstance-server-1057693331</nova:name>
Aug 01 17:17:03 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:17:02</nova:creationTime>
Aug 01 17:17:03 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:17:03 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:17:03 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:17:03 user nova-compute[72184]:       <nova:owner>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:user uuid="4174219695504fc4bae42cb9c2aff01d">tempest-TestShelveInstance-892605189-project-member</nova:user>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:project uuid="e27e54f115ee4626a138b42169a64b31">tempest-TestShelveInstance-892605189</nova:project>
Aug 01 17:17:03 user nova-compute[72184]:       </nova:owner>
Aug 01 17:17:03 user nova-compute[72184]:       <nova:ports>
Aug 01 17:17:03 user nova-compute[72184]:         <nova:port uuid="95f6c24c-d159-479b-9ff2-6539a254d388">
Aug 01 17:17:03 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 17:17:03 user nova-compute[72184]:         </nova:port>
Aug 01 17:17:03 user nova-compute[72184]:       </nova:ports>
Aug 01 17:17:03 user nova-compute[72184]:     </nova:instance>
Aug 01 17:17:03 user nova-compute[72184]:   </metadata>
Aug 01 17:17:03 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:17:03 user nova-compute[72184]:     <system>
Aug 01 17:17:03 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:17:03 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:17:03 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:17:03 user nova-compute[72184]:       <entry name="serial">c7d35dee-22ac-440b-8a9e-994831bbc55c</entry>
Aug 01 17:17:03 user nova-compute[72184]:       <entry name="uuid">c7d35dee-22ac-440b-8a9e-994831bbc55c</entry>
Aug 01 17:17:03 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:17:03 user nova-compute[72184]:     </system>
Aug 01 17:17:03 user nova-compute[72184]:   </sysinfo>
Aug 01 17:17:03 user nova-compute[72184]:   <os>
Aug 01 17:17:03 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:17:03 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:17:03 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:17:03 user nova-compute[72184]:   </os>
Aug 01 17:17:03 user nova-compute[72184]:   <features>
Aug 01 17:17:03 user nova-compute[72184]:     <acpi/>
Aug 01 17:17:03 user nova-compute[72184]:     <apic/>
Aug 01 17:17:03 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:17:03 user nova-compute[72184]:   </features>
Aug 01 17:17:03 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:17:03 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:17:03 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:17:03 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:17:03 user nova-compute[72184]:   </clock>
Aug 01 17:17:03 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:17:03 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:17:03 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:17:03 user nova-compute[72184]:   </cpu>
Aug 01 17:17:03 user nova-compute[72184]:   <devices>
Aug 01 17:17:03 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:17:03 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:17:03 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:17:03 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:17:03 user nova-compute[72184]:       <serial>eaa0d8a0-7b05-472d-a489-88a893fb7bd3</serial>
Aug 01 17:17:03 user nova-compute[72184]:     </disk>
Aug 01 17:17:03 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:17:03 user nova-compute[72184]:       <mac address="fa:16:3e:7b:3a:bf"/>
Aug 01 17:17:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:17:03 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:17:03 user nova-compute[72184]:       <target dev="tap95f6c24c-d1"/>
Aug 01 17:17:03 user nova-compute[72184]:     </interface>
Aug 01 17:17:03 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:17:03 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c/console.log" append="off"/>
Aug 01 17:17:03 user nova-compute[72184]:     </serial>
Aug 01 17:17:03 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:17:03 user nova-compute[72184]:     <video>
Aug 01 17:17:03 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:17:03 user nova-compute[72184]:     </video>
Aug 01 17:17:03 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:17:03 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:17:03 user nova-compute[72184]:     </rng>
Aug 01 17:17:03 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:17:03 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:17:03 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:17:03 user nova-compute[72184]:     </memballoon>
Aug 01 17:17:03 user nova-compute[72184]:   </devices>
Aug 01 17:17:03 user nova-compute[72184]: </domain>
Aug 01 17:17:03 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1057693331',display_name='tempest-TestShelveInstance-server-1057693331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1057693331',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYIBxkH1dfoBtkKcc+ujWV85mfifnLhQYJBWksWsovla7FlpasFj0E2UptyY4dj5F1LZWxhbmFwb1BALqN/KV70bJXwIRY1T2KhQ01diFBoJ9Ow9HEu9ujXf+zfICsRzw==',key_name='tempest-TestShelveInstance-811487968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e27e54f115ee4626a138b42169a64b31',ramdisk_id='',reservation_id='r-c94jav0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-892605189',owner_user_name='tempest-TestShelveInstance-892605189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:16:54Z,user_data=None,user_id='4174219695504fc4bae42cb9c2aff01d',uuid=c7d35dee-22ac-440b-8a9e-994831bbc55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converting VIF {"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG os_vif [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95f6c24c-d1, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95f6c24c-d1, col_values=(('external_ids', {'iface-id': '95f6c24c-d159-479b-9ff2-6539a254d388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3a:bf', 'vm-uuid': 'c7d35dee-22ac-440b-8a9e-994831bbc55c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:03 user nova-compute[72184]: INFO os_vif [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1')
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:17:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] No VIF found with MAC fa:16:3e:7b:3a:bf, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:17:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:04 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-833b23e1-7c72-4213-ac6b-6c76575d5e7d req-51b8b6d5-d29d-4976-96c5-c412c408c8ee service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-833b23e1-7c72-4213-ac6b-6c76575d5e7d req-51b8b6d5-d29d-4976-96c5-c412c408c8ee service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-833b23e1-7c72-4213-ac6b-6c76575d5e7d req-51b8b6d5-d29d-4976-96c5-c412c408c8ee service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-833b23e1-7c72-4213-ac6b-6c76575d5e7d req-51b8b6d5-d29d-4976-96c5-c412c408c8ee service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-833b23e1-7c72-4213-ac6b-6c76575d5e7d req-51b8b6d5-d29d-4976-96c5-c412c408c8ee service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:17:05 user nova-compute[72184]: WARNING nova.compute.manager [req-833b23e1-7c72-4213-ac6b-6c76575d5e7d req-51b8b6d5-d29d-4976-96c5-c412c408c8ee service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state building and task_state spawning.
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910227.2030146, c7d35dee-22ac-440b-8a9e-994831bbc55c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] VM Resumed (Lifecycle Event)
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance spawned successfully.
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910227.2114236, c7d35dee-22ac-440b-8a9e-994831bbc55c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] VM Started (Lifecycle Event)
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:07 user nova-compute[72184]: INFO nova.compute.manager [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Took 14.05 seconds to build instance.
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c24c2708-95fd-465f-b348-b0a574816693 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.164s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-12a1651e-cbf6-4341-b440-858e1b03bd37 req-61388901-b710-469c-aca5-0f7fc80e5f13 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12a1651e-cbf6-4341-b440-858e1b03bd37 req-61388901-b710-469c-aca5-0f7fc80e5f13 service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12a1651e-cbf6-4341-b440-858e1b03bd37 req-61388901-b710-469c-aca5-0f7fc80e5f13 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-12a1651e-cbf6-4341-b440-858e1b03bd37 req-61388901-b710-469c-aca5-0f7fc80e5f13 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-12a1651e-cbf6-4341-b440-858e1b03bd37 req-61388901-b710-469c-aca5-0f7fc80e5f13 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:17:07 user nova-compute[72184]: WARNING nova.compute.manager [req-12a1651e-cbf6-4341-b440-858e1b03bd37 req-61388901-b710-469c-aca5-0f7fc80e5f13 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state active and task_state None.
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:17:07 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:17:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=25.267356872558594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance c7d35dee-22ac-440b-8a9e-994831bbc55c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [{"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-d1dd83d5-7a23-4ad2-878d-77a06c31d032" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:17:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:15 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:17:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:17:34 user nova-compute[72184]: INFO nova.compute.claims [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Claim successful on node user
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:17:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:17:34 user nova-compute[72184]: INFO nova.virt.block_device [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Booting with volume 1e46f08e-a499-4ded-b913-6561d1ffd577 at /dev/vda
Aug 01 17:17:34 user nova-compute[72184]: DEBUG os_brick.utils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG nova.policy [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce144879b7e4638822f0d7174693575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf5145289cf4667b9398df4a8266bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[637cc594-c299-4255-8797-ffa4d72aaf5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc3655-ce06-4ba4-8a9b-adac337a8d8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1024bf-2b7b-48cc-93b5-f49007e2ac96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e174203-08f4-4857-b452-3c76b1b20bb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:17:35 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:17:35 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[01307d3e-45d7-4ee7-96b3-b6729ecdf465]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:17:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:17:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:17:35 user nova-compute[72184]: DEBUG os_brick.utils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:17:35 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updating existing volume attachment record: c37d34ec-bcd1-4671-ae43-cdcca5df4e8c {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:17:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Successfully created port: 1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Successfully updated port: 1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquired lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-changed-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Refreshing instance network info cache due to event network-changed-1d284541-be6f-4fca-848f-93126a1ab16e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] Acquiring lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updating instance_info_cache with network_info: [{"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Releasing lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Instance network_info: |[{"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] Acquired lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:17:36 user nova-compute[72184]: DEBUG nova.network.neutron [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Refreshing network info cache for port 1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:17:37 user nova-compute[72184]: DEBUG nova.network.neutron [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updated VIF entry in instance network info cache for port 1d284541-be6f-4fca-848f-93126a1ab16e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:17:37 user nova-compute[72184]: DEBUG nova.network.neutron [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updating instance_info_cache with network_info: [{"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:17:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9734bb4a-df1b-41df-8af2-7c94c528a4ee req-6de6ca2d-c4ab-4277-b34f-04fa33a20895 service nova] Releasing lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:17:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:17:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Creating image(s)
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Ensure instance console log exists: /opt/stack/data/nova/instances/98a7003b-936a-49aa-9038-7f3dc0dc633c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Start _get_guest_xml network_info=[{"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'c37d34ec-bcd1-4671-ae43-cdcca5df4e8c', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98a7003b-936a-49aa-9038-7f3dc0dc633c', 'attached_at': '', 'detached_at': '', 'volume_id': '1e46f08e-a499-4ded-b913-6561d1ffd577', 'serial': '1e46f08e-a499-4ded-b913-6561d1ffd577'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:17:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:42 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:17:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:17:42 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:17:42 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067f42b-efc3-42d5-a97e-cd60dd9cbc27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:17:42 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d057d-d45c-4823-899d-083f00cd1997]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577] added
Aug 01 17:17:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4bf32a-e40b-4ddc-bda2-3bf5b55fde77]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb91868-bd84-4c3a-a9d2-64b6f69f381c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLmkNtVX {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLmkNtVX" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc387134-873e-4b5e-89ac-6cce47875c51]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aLmkNtVX'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44aba5e-09a7-413d-9a0e-a2981e8e79c8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d37dc4-6127-488a-976b-b5387c396270]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f4463-76ae-4c50-b2b6-ab88cc96abe4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]
Aug 01 17:17:42 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.
Aug 01 17:17:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd124dd-f24f-4133-bb45-b5aa0f171d6c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c110c8ff-7519-40c6-9537-1d89d0b1c254]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:17:42 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef07a6-a827-4d01-8ffe-707315821e6f]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:17:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26138323735343637', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138323735343637', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1643155753',display_name='tempest-TestVolumeBootPattern-server-1643155753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1643155753',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-s6chvn70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:17:35Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=98a7003b-936a-49aa-9038-7f3dc0dc633c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'pci_devices' on Instance uuid 98a7003b-936a-49aa-9038-7f3dc0dc633c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:17:43 user nova-compute[72184]:   <uuid>98a7003b-936a-49aa-9038-7f3dc0dc633c</uuid>
Aug 01 17:17:43 user nova-compute[72184]:   <name>instance-0000002b</name>
Aug 01 17:17:43 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:17:43 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:17:43 user nova-compute[72184]:   <metadata>
Aug 01 17:17:43 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:17:43 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:17:43 user nova-compute[72184]:       <nova:name>tempest-TestVolumeBootPattern-server-1643155753</nova:name>
Aug 01 17:17:43 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:17:42</nova:creationTime>
Aug 01 17:17:43 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:17:43 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:17:43 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:17:43 user nova-compute[72184]:       <nova:owner>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:user uuid="9ce144879b7e4638822f0d7174693575">tempest-TestVolumeBootPattern-1490009883-project-member</nova:user>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:project uuid="7cf5145289cf4667b9398df4a8266bb4">tempest-TestVolumeBootPattern-1490009883</nova:project>
Aug 01 17:17:43 user nova-compute[72184]:       </nova:owner>
Aug 01 17:17:43 user nova-compute[72184]:       <nova:ports>
Aug 01 17:17:43 user nova-compute[72184]:         <nova:port uuid="1d284541-be6f-4fca-848f-93126a1ab16e">
Aug 01 17:17:43 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:17:43 user nova-compute[72184]:         </nova:port>
Aug 01 17:17:43 user nova-compute[72184]:       </nova:ports>
Aug 01 17:17:43 user nova-compute[72184]:     </nova:instance>
Aug 01 17:17:43 user nova-compute[72184]:   </metadata>
Aug 01 17:17:43 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:17:43 user nova-compute[72184]:     <system>
Aug 01 17:17:43 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:17:43 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:17:43 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:17:43 user nova-compute[72184]:       <entry name="serial">98a7003b-936a-49aa-9038-7f3dc0dc633c</entry>
Aug 01 17:17:43 user nova-compute[72184]:       <entry name="uuid">98a7003b-936a-49aa-9038-7f3dc0dc633c</entry>
Aug 01 17:17:43 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:17:43 user nova-compute[72184]:     </system>
Aug 01 17:17:43 user nova-compute[72184]:   </sysinfo>
Aug 01 17:17:43 user nova-compute[72184]:   <os>
Aug 01 17:17:43 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:17:43 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:17:43 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:17:43 user nova-compute[72184]:   </os>
Aug 01 17:17:43 user nova-compute[72184]:   <features>
Aug 01 17:17:43 user nova-compute[72184]:     <acpi/>
Aug 01 17:17:43 user nova-compute[72184]:     <apic/>
Aug 01 17:17:43 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:17:43 user nova-compute[72184]:   </features>
Aug 01 17:17:43 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:17:43 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:17:43 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:17:43 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:17:43 user nova-compute[72184]:   </clock>
Aug 01 17:17:43 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:17:43 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:17:43 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:17:43 user nova-compute[72184]:   </cpu>
Aug 01 17:17:43 user nova-compute[72184]:   <devices>
Aug 01 17:17:43 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:17:43 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:17:43 user nova-compute[72184]:       <source dev="/dev/sdd"/>
Aug 01 17:17:43 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:17:43 user nova-compute[72184]:       <serial>1e46f08e-a499-4ded-b913-6561d1ffd577</serial>
Aug 01 17:17:43 user nova-compute[72184]:     </disk>
Aug 01 17:17:43 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:17:43 user nova-compute[72184]:       <mac address="fa:16:3e:5e:44:a8"/>
Aug 01 17:17:43 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:17:43 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:17:43 user nova-compute[72184]:       <target dev="tap1d284541-be"/>
Aug 01 17:17:43 user nova-compute[72184]:     </interface>
Aug 01 17:17:43 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:17:43 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/98a7003b-936a-49aa-9038-7f3dc0dc633c/console.log" append="off"/>
Aug 01 17:17:43 user nova-compute[72184]:     </serial>
Aug 01 17:17:43 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:17:43 user nova-compute[72184]:     <video>
Aug 01 17:17:43 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:17:43 user nova-compute[72184]:     </video>
Aug 01 17:17:43 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:17:43 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:17:43 user nova-compute[72184]:     </rng>
Aug 01 17:17:43 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:17:43 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:17:43 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:17:43 user nova-compute[72184]:     </memballoon>
Aug 01 17:17:43 user nova-compute[72184]:   </devices>
Aug 01 17:17:43 user nova-compute[72184]: </domain>
Aug 01 17:17:43 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1643155753',display_name='tempest-TestVolumeBootPattern-server-1643155753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1643155753',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-s6chvn70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:17:35Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=98a7003b-936a-49aa-9038-7f3dc0dc633c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG os_vif [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d284541-be, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d284541-be, col_values=(('external_ids', {'iface-id': '1d284541-be6f-4fca-848f-93126a1ab16e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:44:a8', 'vm-uuid': '98a7003b-936a-49aa-9038-7f3dc0dc633c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:43 user nova-compute[72184]: INFO os_vif [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be')
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:17:43 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No VIF found with MAC fa:16:3e:5e:44:a8, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-51a13b9b-5a95-4b80-92c1-9197a219a3ba req-54199aed-50a3-4e0b-a451-b7b49ebcfa90 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-51a13b9b-5a95-4b80-92c1-9197a219a3ba req-54199aed-50a3-4e0b-a451-b7b49ebcfa90 service nova] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-51a13b9b-5a95-4b80-92c1-9197a219a3ba req-54199aed-50a3-4e0b-a451-b7b49ebcfa90 service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-51a13b9b-5a95-4b80-92c1-9197a219a3ba req-54199aed-50a3-4e0b-a451-b7b49ebcfa90 service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-51a13b9b-5a95-4b80-92c1-9197a219a3ba req-54199aed-50a3-4e0b-a451-b7b49ebcfa90 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] No waiting events found dispatching network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:17:45 user nova-compute[72184]: WARNING nova.compute.manager [req-51a13b9b-5a95-4b80-92c1-9197a219a3ba req-54199aed-50a3-4e0b-a451-b7b49ebcfa90 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received unexpected event network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e for instance with vm_state building and task_state spawning.
Aug 01 17:17:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910267.0863109, 98a7003b-936a-49aa-9038-7f3dc0dc633c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] VM Resumed (Lifecycle Event)
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Instance spawned successfully.
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910267.0876355, 98a7003b-936a-49aa-9038-7f3dc0dc633c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] VM Started (Lifecycle Event)
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:47 user nova-compute[72184]: INFO nova.compute.manager [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Took 12.92 seconds to build instance.
Aug 01 17:17:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7a7a183a-4eb6-4ba4-9a2b-3d13cca5c62e tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.016s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-0e9ee2d8-a1e1-4de7-9a66-a405caaf0c13 req-1837a2ea-a6f7-47b5-829f-bdbf3ae0f3bc service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0e9ee2d8-a1e1-4de7-9a66-a405caaf0c13 req-1837a2ea-a6f7-47b5-829f-bdbf3ae0f3bc service nova] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0e9ee2d8-a1e1-4de7-9a66-a405caaf0c13 req-1837a2ea-a6f7-47b5-829f-bdbf3ae0f3bc service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0e9ee2d8-a1e1-4de7-9a66-a405caaf0c13 req-1837a2ea-a6f7-47b5-829f-bdbf3ae0f3bc service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-0e9ee2d8-a1e1-4de7-9a66-a405caaf0c13 req-1837a2ea-a6f7-47b5-829f-bdbf3ae0f3bc service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] No waiting events found dispatching network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:17:47 user nova-compute[72184]: WARNING nova.compute.manager [req-0e9ee2d8-a1e1-4de7-9a66-a405caaf0c13 req-1837a2ea-a6f7-47b5-829f-bdbf3ae0f3bc service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received unexpected event network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e for instance with vm_state active and task_state None.
Aug 01 17:17:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:17:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:17:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:17:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'info_cache' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:17:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance destroyed successfully.
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'resources' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:16:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG os_vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap445659c5-55, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:17:53 user nova-compute[72184]: INFO os_vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55')
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start _get_guest_xml network_info=[{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'numa_topology' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:53 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:16:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'pci_devices' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:17:53 user nova-compute[72184]:   <uuid>48948157-6480-4c91-935d-37cd84a8b12c</uuid>
Aug 01 17:17:53 user nova-compute[72184]:   <name>instance-00000025</name>
Aug 01 17:17:53 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:17:53 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:17:53 user nova-compute[72184]:   <metadata>
Aug 01 17:17:53 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:17:53 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:17:53 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeTestJSON-server-168633703</nova:name>
Aug 01 17:17:53 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:17:53</nova:creationTime>
Aug 01 17:17:53 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:17:53 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:17:53 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:17:53 user nova-compute[72184]:       <nova:owner>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:user uuid="6a5af08a5f7d46bdb7512360bcae3905">tempest-AttachVolumeTestJSON-984518084-project-member</nova:user>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:project uuid="88373a3db0cb453b99f922d0a1a31781">tempest-AttachVolumeTestJSON-984518084</nova:project>
Aug 01 17:17:53 user nova-compute[72184]:       </nova:owner>
Aug 01 17:17:53 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:17:53 user nova-compute[72184]:       <nova:ports>
Aug 01 17:17:53 user nova-compute[72184]:         <nova:port uuid="445659c5-5542-4629-9a26-80aca641662f">
Aug 01 17:17:53 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 17:17:53 user nova-compute[72184]:         </nova:port>
Aug 01 17:17:53 user nova-compute[72184]:       </nova:ports>
Aug 01 17:17:53 user nova-compute[72184]:     </nova:instance>
Aug 01 17:17:53 user nova-compute[72184]:   </metadata>
Aug 01 17:17:53 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:17:53 user nova-compute[72184]:     <system>
Aug 01 17:17:53 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:17:53 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:17:53 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:17:53 user nova-compute[72184]:       <entry name="serial">48948157-6480-4c91-935d-37cd84a8b12c</entry>
Aug 01 17:17:53 user nova-compute[72184]:       <entry name="uuid">48948157-6480-4c91-935d-37cd84a8b12c</entry>
Aug 01 17:17:53 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:17:53 user nova-compute[72184]:     </system>
Aug 01 17:17:53 user nova-compute[72184]:   </sysinfo>
Aug 01 17:17:53 user nova-compute[72184]:   <os>
Aug 01 17:17:53 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:17:53 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:17:53 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:17:53 user nova-compute[72184]:   </os>
Aug 01 17:17:53 user nova-compute[72184]:   <features>
Aug 01 17:17:53 user nova-compute[72184]:     <acpi/>
Aug 01 17:17:53 user nova-compute[72184]:     <apic/>
Aug 01 17:17:53 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:17:53 user nova-compute[72184]:   </features>
Aug 01 17:17:53 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:17:53 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:17:53 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:17:53 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:17:53 user nova-compute[72184]:   </clock>
Aug 01 17:17:53 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:17:53 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:17:53 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:17:53 user nova-compute[72184]:   </cpu>
Aug 01 17:17:53 user nova-compute[72184]:   <devices>
Aug 01 17:17:53 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:17:53 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:17:53 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk"/>
Aug 01 17:17:53 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:17:53 user nova-compute[72184]:     </disk>
Aug 01 17:17:53 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:17:53 user nova-compute[72184]:       <mac address="fa:16:3e:4f:48:93"/>
Aug 01 17:17:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:17:53 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:17:53 user nova-compute[72184]:       <target dev="tap445659c5-55"/>
Aug 01 17:17:53 user nova-compute[72184]:     </interface>
Aug 01 17:17:53 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:17:53 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/console.log" append="off"/>
Aug 01 17:17:53 user nova-compute[72184]:     </serial>
Aug 01 17:17:53 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:17:53 user nova-compute[72184]:     <video>
Aug 01 17:17:53 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:17:53 user nova-compute[72184]:     </video>
Aug 01 17:17:53 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:17:53 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:17:53 user nova-compute[72184]:     </rng>
Aug 01 17:17:53 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:17:53 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:17:53 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:17:53 user nova-compute[72184]:     </memballoon>
Aug 01 17:17:53 user nova-compute[72184]:   </devices>
Aug 01 17:17:53 user nova-compute[72184]: </domain>
Aug 01 17:17:53 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.154s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Cannot resize image /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:17:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'migration_context' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:16:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG os_vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap445659c5-55, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap445659c5-55, col_values=(('external_ids', {'iface-id': '445659c5-5542-4629-9a26-80aca641662f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:48:93', 'vm-uuid': '48948157-6480-4c91-935d-37cd84a8b12c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:17:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:54 user nova-compute[72184]: INFO os_vif [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55')
Aug 01 17:17:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-febe2db1-dc43-489a-a079-e6d4580ca7fe req-0f34430a-d87d-4ea3-b173-37b72fb4789a service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-febe2db1-dc43-489a-a079-e6d4580ca7fe req-0f34430a-d87d-4ea3-b173-37b72fb4789a service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-febe2db1-dc43-489a-a079-e6d4580ca7fe req-0f34430a-d87d-4ea3-b173-37b72fb4789a service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-febe2db1-dc43-489a-a079-e6d4580ca7fe req-0f34430a-d87d-4ea3-b173-37b72fb4789a service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:55 user nova-compute[72184]: DEBUG nova.compute.manager [req-febe2db1-dc43-489a-a079-e6d4580ca7fe req-0f34430a-d87d-4ea3-b173-37b72fb4789a service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:17:55 user nova-compute[72184]: WARNING nova.compute.manager [req-febe2db1-dc43-489a-a079-e6d4580ca7fe req-0f34430a-d87d-4ea3-b173-37b72fb4789a service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state stopped and task_state powering-on.
Aug 01 17:17:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910277.5809667, 48948157-6480-4c91-935d-37cd84a8b12c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:17:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Resumed (Lifecycle Event)
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:17:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance rebooted successfully.
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0bac437d-00df-473e-8aa6-9e16e5531212 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:17:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910277.5865803, 48948157-6480-4c91-935d-37cd84a8b12c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:17:57 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Started (Lifecycle Event)
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-2465ab97-e3a6-488d-934d-0a6d8bf1445c req-baff6805-da51-400a-b9fd-cef0c6ffb514 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2465ab97-e3a6-488d-934d-0a6d8bf1445c req-baff6805-da51-400a-b9fd-cef0c6ffb514 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2465ab97-e3a6-488d-934d-0a6d8bf1445c req-baff6805-da51-400a-b9fd-cef0c6ffb514 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2465ab97-e3a6-488d-934d-0a6d8bf1445c req-baff6805-da51-400a-b9fd-cef0c6ffb514 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:17:57 user nova-compute[72184]: DEBUG nova.compute.manager [req-2465ab97-e3a6-488d-934d-0a6d8bf1445c req-baff6805-da51-400a-b9fd-cef0c6ffb514 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:17:57 user nova-compute[72184]: WARNING nova.compute.manager [req-2465ab97-e3a6-488d-934d-0a6d8bf1445c req-baff6805-da51-400a-b9fd-cef0c6ffb514 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state active and task_state None.
Aug 01 17:17:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:17:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:05 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:18:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:18:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8214MB free_disk=25.263587951660156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance c7d35dee-22ac-440b-8a9e-994831bbc55c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 98a7003b-936a-49aa-9038-7f3dc0dc633c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:18:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:12 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:18:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:18:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:18 user nova-compute[72184]: INFO nova.compute.manager [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Detaching volume 6c500cf4-6efc-4376-9c74-849fe732d9f5
Aug 01 17:18:18 user nova-compute[72184]: INFO nova.virt.block_device [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Attempting to driver detach volume 6c500cf4-6efc-4376-9c74-849fe732d9f5 from mountpoint /dev/vdc
Aug 01 17:18:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Attempting to detach device vdc from instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:18:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:18:18 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:18:18 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:18:18 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:18:18 user nova-compute[72184]:   <serial>6c500cf4-6efc-4376-9c74-849fe732d9f5</serial>
Aug 01 17:18:18 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:18:18 user nova-compute[72184]: </disk>
Aug 01 17:18:18 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:18:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully detached device vdc from instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 from the persistent domain config.
Aug 01 17:18:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:18:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:18:18 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:18:18 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:18:18 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:18:18 user nova-compute[72184]:   <serial>6c500cf4-6efc-4376-9c74-849fe732d9f5</serial>
Aug 01 17:18:18 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 17:18:18 user nova-compute[72184]: </disk>
Aug 01 17:18:18 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910299.2391484, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:18:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully detached device vdc from instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 from the live domain config.
Aug 01 17:18:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBvLhdtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:18:19 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40903f-9633-4735-ab5b-45e62fe34aa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[270ca7d0-7c3b-4547-90bc-6e1fa1c25c5c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:18:19 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:18:19 user nova-compute[72184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:18:19 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 (non-flash)
Aug 01 17:18:19 user nova-compute[72184]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:18:19 user nova-compute[72184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:18:19 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3018448c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e3ace-3c10-4b8b-a170-2fd8f5c28377]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b704ae9-3541-496f-877b-6b993ac33b42]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a8348f-1e82-4869-8ed5-66a4215b211e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bed411-1538-48da-8143-66376fda017d]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe29ae32-f0ef-479a-81cb-7b3648949592]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62a7ee5-5bdd-407d-b924-32498fa9e9bd]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260]
Aug 01 17:18:19 user nova-compute[72184]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5, portal: 172.16.0.220,3260] successful.
Aug 01 17:18:19 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c500cf4-6efc-4376-9c74-849fe732d9f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d1837-63c8-4bc1-8a36-29825fad0a49]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] <== disconnect_volume: return (280ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:18:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'flavor' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:18:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-58e44173-aa68-4afc-8eab-3c7ef3b6966d tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.601s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:18:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:18:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:18:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:18:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 98a7003b-936a-49aa-9038-7f3dc0dc633c {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing instance network info cache due to event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG nova.network.neutron [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG nova.network.neutron [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updated VIF entry in instance network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG nova.network.neutron [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-b48825b3-97e7-46f0-8e57-dda20ef907ba req-d90c2600-11b8-47b3-9bdd-9a20adf1b0b5 service nova] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:45 user nova-compute[72184]: INFO nova.compute.manager [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Shelve offloading
Aug 01 17:18:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-d6f3f00d-7f59-442d-80b9-b12375bc276d req-10ea777f-a927-47e0-8e2c-9ed3ce0b25a8 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-unplugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d6f3f00d-7f59-442d-80b9-b12375bc276d req-10ea777f-a927-47e0-8e2c-9ed3ce0b25a8 service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d6f3f00d-7f59-442d-80b9-b12375bc276d req-10ea777f-a927-47e0-8e2c-9ed3ce0b25a8 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d6f3f00d-7f59-442d-80b9-b12375bc276d req-10ea777f-a927-47e0-8e2c-9ed3ce0b25a8 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-d6f3f00d-7f59-442d-80b9-b12375bc276d req-10ea777f-a927-47e0-8e2c-9ed3ce0b25a8 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-unplugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:18:46 user nova-compute[72184]: WARNING nova.compute.manager [req-d6f3f00d-7f59-442d-80b9-b12375bc276d req-10ea777f-a927-47e0-8e2c-9ed3ce0b25a8 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-unplugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state active and task_state shelving.
Aug 01 17:18:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance destroyed successfully.
Aug 01 17:18:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:18:46 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:18:47 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance destroyed successfully.
Aug 01 17:18:47 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'resources' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1057693331',display_name='tempest-TestShelveInstance-server-1057693331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1057693331',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYIBxkH1dfoBtkKcc+ujWV85mfifnLhQYJBWksWsovla7FlpasFj0E2UptyY4dj5F1LZWxhbmFwb1BALqN/KV70bJXwIRY1T2KhQ01diFBoJ9Ow9HEu9ujXf+zfICsRzw==',key_name='tempest-TestShelveInstance-811487968',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e27e54f115ee4626a138b42169a64b31',ramdisk_id='',reservation_id='r-c94jav0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-892605189',owner_user_name='tempest-TestShelveInstance-892605189-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:17:07Z,user_data=None,user_id='4174219695504fc4bae42cb9c2aff01d',uuid=c7d35dee-22ac-440b-8a9e-994831bbc55c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converting VIF {"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_vif [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95f6c24c-d1, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:47 user nova-compute[72184]: INFO os_vif [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1')
Aug 01 17:18:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:18:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99eb427-aeb7-4385-b756-fd6d7b79a7dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada1de0-2190-4bbe-b686-0a49298a1b9a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:18:47 user nova-compute[72184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:18:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:18:47 user nova-compute[72184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:18:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8382b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[151cfb34-815a-4168-ad7b-aa236111d2b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5973a-fa45-4b32-a27d-374e3098647a]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a8644-142d-456e-9ba1-befc7137f179]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59869ba-f141-46f4-98e1-97fe376b3e61]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc13a5d-dbf2-466f-989c-9bdc9b1d4ef1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a815e2ab-c714-45da-8b22-0cf7a08bc518]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]
Aug 01 17:18:47 user nova-compute[72184]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.
Aug 01 17:18:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:18:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ae81b-adaa-465d-98a3-71c7b082c80e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] <== disconnect_volume: return (296ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:18:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Deleting instance files /opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c_del
Aug 01 17:18:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Deletion of /opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c_del complete
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:18:48 user nova-compute[72184]: WARNING nova.compute.manager [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state active and task_state shelving.
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.compute.manager [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing instance network info cache due to event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updated VIF entry in instance network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.network.neutron [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": null, "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8ba982e1-e9b0-43b3-9e98-abb1d5de7a0a req-037d96fd-2bfe-4402-85e5-007feba3d310 service nova] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:18:48 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Deleted allocations for instance c7d35dee-22ac-440b-8a9e-994831bbc55c
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:18:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'numa_topology' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:18:49 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:18:49 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:18:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e033604a-1c51-41b4-965e-bb8ee7d7ce04 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.448s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:18:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:18:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:01 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910326.5246084, c7d35dee-22ac-440b-8a9e-994831bbc55c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:19:01 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] VM Stopped (Lifecycle Event)
Aug 01 17:19:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-926daaac-546b-4721-a386-b228b72e5ae0 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:19:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:19:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:19:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:19:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:19:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:19:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:19:09 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=25.254520416259766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:09 user nova-compute[72184]: INFO nova.compute.manager [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Terminating instance
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 48948157-6480-4c91-935d-37cd84a8b12c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 98a7003b-936a-49aa-9038-7f3dc0dc633c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-e58ea9ab-7a89-46de-8971-0f0fccbd8c6a req-1cb06c83-a7b4-47df-9c21-f23997e4e37d service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-unplugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e58ea9ab-7a89-46de-8971-0f0fccbd8c6a req-1cb06c83-a7b4-47df-9c21-f23997e4e37d service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e58ea9ab-7a89-46de-8971-0f0fccbd8c6a req-1cb06c83-a7b4-47df-9c21-f23997e4e37d service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e58ea9ab-7a89-46de-8971-0f0fccbd8c6a req-1cb06c83-a7b4-47df-9c21-f23997e4e37d service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-e58ea9ab-7a89-46de-8971-0f0fccbd8c6a req-1cb06c83-a7b4-47df-9c21-f23997e4e37d service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-unplugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-e58ea9ab-7a89-46de-8971-0f0fccbd8c6a req-1cb06c83-a7b4-47df-9c21-f23997e4e37d service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-unplugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:19:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Instance destroyed successfully.
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'resources' on Instance uuid d1dd83d5-7a23-4ad2-878d-77a06c31d032 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1292560231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1292560231',id=40,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO67PZsPYZ8xmaJ30U8JUyLtBfAghfo/cD30xvMocfHHS8ijjAlFMx/CgPDCX/ajwRrpC+dJwwxYQwJpyS09ymzkamKC6EMhcFkLg6UtIf9w9baQKprKGmw9D2hC4CxGaQ==',key_name='tempest-keypair-239810973',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:16:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-e1qxq807',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=d1dd83d5-7a23-4ad2-878d-77a06c31d032,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "address": "fa:16:3e:3e:9d:2f", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d434ee0-52", "ovs_interfaceid": "5d434ee0-529b-4df1-a3de-88abd908cd8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG os_vif [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d434ee0-52, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:19:09 user nova-compute[72184]: INFO os_vif [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9d:2f,bridge_name='br-int',has_traffic_filtering=True,id=5d434ee0-529b-4df1-a3de-88abd908cd8a,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d434ee0-52')
Aug 01 17:19:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Deleting instance files /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032_del
Aug 01 17:19:10 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Deletion of /opt/stack/data/nova/instances/d1dd83d5-7a23-4ad2-878d-77a06c31d032_del complete
Aug 01 17:19:10 user nova-compute[72184]: INFO nova.compute.manager [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 17:19:10 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:19:10 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:19:10 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:19:10 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-f7440ec7-bba2-4710-9324-68c148d42247 req-9543bbf5-9ad7-4f75-9bd8-58d18ef68d11 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-deleted-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:11 user nova-compute[72184]: INFO nova.compute.manager [req-f7440ec7-bba2-4710-9324-68c148d42247 req-9543bbf5-9ad7-4f75-9bd8-58d18ef68d11 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Neutron deleted interface 5d434ee0-529b-4df1-a3de-88abd908cd8a; detaching it from the instance and deleting it from the info cache
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.network.neutron [req-f7440ec7-bba2-4710-9324-68c148d42247 req-9543bbf5-9ad7-4f75-9bd8-58d18ef68d11 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:19:11 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Took 0.94 seconds to deallocate network for instance.
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-f7440ec7-bba2-4710-9324-68c148d42247 req-9543bbf5-9ad7-4f75-9bd8-58d18ef68d11 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Detach interface failed, port_id=5d434ee0-529b-4df1-a3de-88abd908cd8a, reason: Instance d1dd83d5-7a23-4ad2-878d-77a06c31d032 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:11 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Deleted allocations for instance d1dd83d5-7a23-4ad2-878d-77a06c31d032
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b15014f6-621a-4447-802b-0eb0a69927cd tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c6cde81-8e61-416d-aa2a-27eff784558a req-d0b2ec73-3651-433c-9625-06b87ae43305 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c6cde81-8e61-416d-aa2a-27eff784558a req-d0b2ec73-3651-433c-9625-06b87ae43305 service nova] Acquiring lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c6cde81-8e61-416d-aa2a-27eff784558a req-d0b2ec73-3651-433c-9625-06b87ae43305 service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c6cde81-8e61-416d-aa2a-27eff784558a req-d0b2ec73-3651-433c-9625-06b87ae43305 service nova] Lock "d1dd83d5-7a23-4ad2-878d-77a06c31d032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:11 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c6cde81-8e61-416d-aa2a-27eff784558a req-d0b2ec73-3651-433c-9625-06b87ae43305 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] No waiting events found dispatching network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:19:11 user nova-compute[72184]: WARNING nova.compute.manager [req-9c6cde81-8e61-416d-aa2a-27eff784558a req-d0b2ec73-3651-433c-9625-06b87ae43305 service nova] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Received unexpected event network-vif-plugged-5d434ee0-529b-4df1-a3de-88abd908cd8a for instance with vm_state deleted and task_state None.
Aug 01 17:19:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:19:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [{"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-48948157-6480-4c91-935d-37cd84a8b12c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:19:15 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:19:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910349.9577253, d1dd83d5-7a23-4ad2-878d-77a06c31d032 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:19:24 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] VM Stopped (Lifecycle Event)
Aug 01 17:19:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-fcd8e9f3-f1b9-4f7c-b127-7464df83289c None None] [instance: d1dd83d5-7a23-4ad2-878d-77a06c31d032] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:19:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-changed-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Refreshing instance network info cache due to event network-changed-1d284541-be6f-4fca-848f-93126a1ab16e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] Acquiring lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] Acquired lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Refreshing network info cache for port 1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updated VIF entry in instance network info cache for port 1d284541-be6f-4fca-848f-93126a1ab16e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updating instance_info_cache with network_info: [{"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:19:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-cadbd0d1-d9db-4dff-adeb-d54c62ceee56 req-d1350a42-148e-4e02-a5d9-b9d09105d3f9 service nova] Releasing lock "refresh_cache-98a7003b-936a-49aa-9038-7f3dc0dc633c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:27 user nova-compute[72184]: INFO nova.compute.manager [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Terminating instance
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-292ab05a-99e2-4b5f-8367-d26f2a607dd0 req-fe5beeae-5cb6-49f2-ae0d-0be5a38ad1bf service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-vif-unplugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-292ab05a-99e2-4b5f-8367-d26f2a607dd0 req-fe5beeae-5cb6-49f2-ae0d-0be5a38ad1bf service nova] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-292ab05a-99e2-4b5f-8367-d26f2a607dd0 req-fe5beeae-5cb6-49f2-ae0d-0be5a38ad1bf service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-292ab05a-99e2-4b5f-8367-d26f2a607dd0 req-fe5beeae-5cb6-49f2-ae0d-0be5a38ad1bf service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-292ab05a-99e2-4b5f-8367-d26f2a607dd0 req-fe5beeae-5cb6-49f2-ae0d-0be5a38ad1bf service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] No waiting events found dispatching network-vif-unplugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-292ab05a-99e2-4b5f-8367-d26f2a607dd0 req-fe5beeae-5cb6-49f2-ae0d-0be5a38ad1bf service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-vif-unplugged-1d284541-be6f-4fca-848f-93126a1ab16e for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:19:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Instance destroyed successfully.
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'resources' on Instance uuid 98a7003b-936a-49aa-9038-7f3dc0dc633c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1643155753',display_name='tempest-TestVolumeBootPattern-server-1643155753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1643155753',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:17:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-s6chvn70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:17:47Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=98a7003b-936a-49aa-9038-7f3dc0dc633c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "1d284541-be6f-4fca-848f-93126a1ab16e", "address": "fa:16:3e:5e:44:a8", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d284541-be", "ovs_interfaceid": "1d284541-be6f-4fca-848f-93126a1ab16e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_vif [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d284541-be, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:19:27 user nova-compute[72184]: INFO os_vif [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:44:a8,bridge_name='br-int',has_traffic_filtering=True,id=1d284541-be6f-4fca-848f-93126a1ab16e,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d284541-be')
Aug 01 17:19:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:19:27 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1994b5-dc79-491f-bca5-baf99d54fb5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2db2c7-6f58-4f59-853e-1f5de8ff6872]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:19:27 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:19:27 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8398f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f2146-2c0f-4eb1-bd8c-66e0ff7a4a34]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2040b51-7cbf-4386-80e3-6627d7110de2]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd16d534-a9ef-43db-ab36-68785a818e12]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:19:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09c964-9d55-4454-9d9b-e4ce857c4e4c]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138323735343637', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d36822', '/dev/disk/by-id/scsi-1SCST_BIO4d36822-a8275467be588af7') {{(pid=83397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2738a2b4-f89a-490a-8d29-545e83ac7029]: (4, None) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d226e-2bbe-482a-84aa-fd0e9ef33ef1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d553f0ca-9c44-444a-8fe4-b849879f8312]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]
Aug 01 17:19:28 user nova-compute[72184]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.
Aug 01 17:19:28 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42c8e75-d17e-4b30-9c60-5212d46d2233]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== disconnect_volume: return (257ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:19:28 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Deleting instance files /opt/stack/data/nova/instances/98a7003b-936a-49aa-9038-7f3dc0dc633c_del
Aug 01 17:19:28 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Deletion of /opt/stack/data/nova/instances/98a7003b-936a-49aa-9038-7f3dc0dc633c_del complete
Aug 01 17:19:28 user nova-compute[72184]: INFO nova.compute.manager [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 01 17:19:28 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:19:28 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:19:29 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Took 0.93 seconds to deallocate network for instance.
Aug 01 17:19:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] Acquiring lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] No waiting events found dispatching network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:19:29 user nova-compute[72184]: WARNING nova.compute.manager [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received unexpected event network-vif-plugged-1d284541-be6f-4fca-848f-93126a1ab16e for instance with vm_state active and task_state deleting.
Aug 01 17:19:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-f16aa5ea-c4fa-4ba6-b06d-a4dccbea0759 req-11a0ef0e-9bbd-42e9-847d-59cf0a58e74c service nova] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Received event network-vif-deleted-1d284541-be6f-4fca-848f-93126a1ab16e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:29 user nova-compute[72184]: INFO nova.compute.manager [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 17:19:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:30 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:19:30 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:19:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:30 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Deleted allocations for instance 98a7003b-936a-49aa-9038-7f3dc0dc633c
Aug 01 17:19:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f6877c54-f565-4b00-a85f-2784bdbc45f8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "98a7003b-936a-49aa-9038-7f3dc0dc633c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:42 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910367.8215072, 98a7003b-936a-49aa-9038-7f3dc0dc633c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:19:42 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] VM Stopped (Lifecycle Event)
Aug 01 17:19:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9db962f6-61e7-45d7-b336-8ef947fcdb47 None None] [instance: 98a7003b-936a-49aa-9038-7f3dc0dc633c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:19:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:43 user nova-compute[72184]: INFO nova.compute.manager [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Terminating instance
Aug 01 17:19:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-13175146-3a2b-497c-bc8e-5157c7db2a32 req-0aabbcc7-774d-4877-825f-3d932f756daf service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-13175146-3a2b-497c-bc8e-5157c7db2a32 req-0aabbcc7-774d-4877-825f-3d932f756daf service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-13175146-3a2b-497c-bc8e-5157c7db2a32 req-0aabbcc7-774d-4877-825f-3d932f756daf service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-13175146-3a2b-497c-bc8e-5157c7db2a32 req-0aabbcc7-774d-4877-825f-3d932f756daf service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-13175146-3a2b-497c-bc8e-5157c7db2a32 req-0aabbcc7-774d-4877-825f-3d932f756daf service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:19:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-13175146-3a2b-497c-bc8e-5157c7db2a32 req-0aabbcc7-774d-4877-825f-3d932f756daf service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-unplugged-445659c5-5542-4629-9a26-80aca641662f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Instance destroyed successfully.
Aug 01 17:19:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'resources' on Instance uuid 48948157-6480-4c91-935d-37cd84a8b12c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168633703',display_name='tempest-AttachVolumeTestJSON-server-168633703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168633703',id=37,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulObYrIxZJHmY7AwLglD82EqkGtbDhiYbTPm53RGnJpNHwWIhyY8NvpOmnBaViABqjlA6T5zydOdBHEVF3bFsy4u2nA57tVHaH2jCSQAvyFUB88+xN3OhNtsZT4rlRrA==',key_name='tempest-keypair-1643021485',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-bme0kmny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=48948157-6480-4c91-935d-37cd84a8b12c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "445659c5-5542-4629-9a26-80aca641662f", "address": "fa:16:3e:4f:48:93", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap445659c5-55", "ovs_interfaceid": "445659c5-5542-4629-9a26-80aca641662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG os_vif [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap445659c5-55, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:19:44 user nova-compute[72184]: INFO os_vif [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:93,bridge_name='br-int',has_traffic_filtering=True,id=445659c5-5542-4629-9a26-80aca641662f,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap445659c5-55')
Aug 01 17:19:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Deleting instance files /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c_del
Aug 01 17:19:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Deletion of /opt/stack/data/nova/instances/48948157-6480-4c91-935d-37cd84a8b12c_del complete
Aug 01 17:19:44 user nova-compute[72184]: INFO nova.compute.manager [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 17:19:44 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-322887dc-ee7f-4c03-a49c-e4afec59804b req-ddc90b97-ea33-45f6-be90-4a53d0d71645 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-322887dc-ee7f-4c03-a49c-e4afec59804b req-ddc90b97-ea33-45f6-be90-4a53d0d71645 service nova] Acquiring lock "48948157-6480-4c91-935d-37cd84a8b12c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-322887dc-ee7f-4c03-a49c-e4afec59804b req-ddc90b97-ea33-45f6-be90-4a53d0d71645 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-322887dc-ee7f-4c03-a49c-e4afec59804b req-ddc90b97-ea33-45f6-be90-4a53d0d71645 service nova] Lock "48948157-6480-4c91-935d-37cd84a8b12c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-322887dc-ee7f-4c03-a49c-e4afec59804b req-ddc90b97-ea33-45f6-be90-4a53d0d71645 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] No waiting events found dispatching network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:19:45 user nova-compute[72184]: WARNING nova.compute.manager [req-322887dc-ee7f-4c03-a49c-e4afec59804b req-ddc90b97-ea33-45f6-be90-4a53d0d71645 service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received unexpected event network-vif-plugged-445659c5-5542-4629-9a26-80aca641662f for instance with vm_state active and task_state deleting.
Aug 01 17:19:46 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:19:46 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Took 1.39 seconds to deallocate network for instance.
Aug 01 17:19:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-87d726c9-e4ca-42af-b209-90da06a91313 req-a769324f-0a7a-4c69-9d72-40ba84aecf1d service nova] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Received event network-vif-deleted-445659c5-5542-4629-9a26-80aca641662f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:19:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:19:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:19:46 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:19:46 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:19:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:46 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Deleted allocations for instance 48948157-6480-4c91-935d-37cd84a8b12c
Aug 01 17:19:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c5ee1af8-e951-4497-99ab-3ee9a7d54bcf tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "48948157-6480-4c91-935d-37cd84a8b12c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.875s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:19:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:59 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910384.447062, 48948157-6480-4c91-935d-37cd84a8b12c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:19:59 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] VM Stopped (Lifecycle Event)
Aug 01 17:19:59 user nova-compute[72184]: DEBUG nova.compute.manager [None req-77bfca17-ee2a-499b-acaa-2891c555adf3 None None] [instance: 48948157-6480-4c91-935d-37cd84a8b12c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:19:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:19:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:20:03 user nova-compute[72184]: INFO nova.compute.claims [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Claim successful on node user
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:20:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.policy [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80fcd66a964e435e9b6494c67e6a9c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fc1bb5f955400196d88dbc81346bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:20:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Creating image(s)
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk 1073741824" returned: 0 in 0.048s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG nova.network.neutron [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Successfully created port: 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Cannot resize image /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG nova.objects.instance [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'migration_context' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Ensure instance console log exists: /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Successfully updated port: 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.compute.manager [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing instance network info cache due to event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.neutron [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance network_info: |[{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.neutron [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Start _get_guest_xml network_info=[{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:20:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:05 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078382299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078382299',id=44,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+P0Qb9g3aA1lqgIZiwJJznmzI6niZsbVwOJY8wqivVz8g1jeoGncxrmbZiKAcslbRKs5vKMTERUWg6cHM5zJv7SFpToZsQ5pprTjq7Tun6z10zbwFwXKG6lok/djrprw==',key_name='tempest-keypair-1732064922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-hbm38lhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=904e24fe-feb4-4349-a9ce-f5921745b35c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.objects.instance [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'pci_devices' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:20:05 user nova-compute[72184]:   <uuid>904e24fe-feb4-4349-a9ce-f5921745b35c</uuid>
Aug 01 17:20:05 user nova-compute[72184]:   <name>instance-0000002c</name>
Aug 01 17:20:05 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:20:05 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:20:05 user nova-compute[72184]:   <metadata>
Aug 01 17:20:05 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:20:05 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:20:05 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2078382299</nova:name>
Aug 01 17:20:05 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:20:05</nova:creationTime>
Aug 01 17:20:05 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:20:05 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:20:05 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:20:05 user nova-compute[72184]:       <nova:owner>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:user uuid="80fcd66a964e435e9b6494c67e6a9c14">tempest-AttachVolumeShelveTestJSON-1405411677-project-member</nova:user>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:project uuid="77fc1bb5f955400196d88dbc81346bb5">tempest-AttachVolumeShelveTestJSON-1405411677</nova:project>
Aug 01 17:20:05 user nova-compute[72184]:       </nova:owner>
Aug 01 17:20:05 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:20:05 user nova-compute[72184]:       <nova:ports>
Aug 01 17:20:05 user nova-compute[72184]:         <nova:port uuid="8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb">
Aug 01 17:20:05 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:20:05 user nova-compute[72184]:         </nova:port>
Aug 01 17:20:05 user nova-compute[72184]:       </nova:ports>
Aug 01 17:20:05 user nova-compute[72184]:     </nova:instance>
Aug 01 17:20:05 user nova-compute[72184]:   </metadata>
Aug 01 17:20:05 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:20:05 user nova-compute[72184]:     <system>
Aug 01 17:20:05 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:20:05 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:20:05 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:20:05 user nova-compute[72184]:       <entry name="serial">904e24fe-feb4-4349-a9ce-f5921745b35c</entry>
Aug 01 17:20:05 user nova-compute[72184]:       <entry name="uuid">904e24fe-feb4-4349-a9ce-f5921745b35c</entry>
Aug 01 17:20:05 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:20:05 user nova-compute[72184]:     </system>
Aug 01 17:20:05 user nova-compute[72184]:   </sysinfo>
Aug 01 17:20:05 user nova-compute[72184]:   <os>
Aug 01 17:20:05 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:20:05 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:20:05 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:20:05 user nova-compute[72184]:   </os>
Aug 01 17:20:05 user nova-compute[72184]:   <features>
Aug 01 17:20:05 user nova-compute[72184]:     <acpi/>
Aug 01 17:20:05 user nova-compute[72184]:     <apic/>
Aug 01 17:20:05 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:20:05 user nova-compute[72184]:   </features>
Aug 01 17:20:05 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:20:05 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:20:05 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:20:05 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:20:05 user nova-compute[72184]:   </clock>
Aug 01 17:20:05 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:20:05 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:20:05 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:20:05 user nova-compute[72184]:   </cpu>
Aug 01 17:20:05 user nova-compute[72184]:   <devices>
Aug 01 17:20:05 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:20:05 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:20:05 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk"/>
Aug 01 17:20:05 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:20:05 user nova-compute[72184]:     </disk>
Aug 01 17:20:05 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:20:05 user nova-compute[72184]:       <mac address="fa:16:3e:7e:7f:87"/>
Aug 01 17:20:05 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:05 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:20:05 user nova-compute[72184]:       <target dev="tap8fbf7b7c-dc"/>
Aug 01 17:20:05 user nova-compute[72184]:     </interface>
Aug 01 17:20:05 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:20:05 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/console.log" append="off"/>
Aug 01 17:20:05 user nova-compute[72184]:     </serial>
Aug 01 17:20:05 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:20:05 user nova-compute[72184]:     <video>
Aug 01 17:20:05 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:05 user nova-compute[72184]:     </video>
Aug 01 17:20:05 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:20:05 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:20:05 user nova-compute[72184]:     </rng>
Aug 01 17:20:05 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:20:05 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:20:05 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:20:05 user nova-compute[72184]:     </memballoon>
Aug 01 17:20:05 user nova-compute[72184]:   </devices>
Aug 01 17:20:05 user nova-compute[72184]: </domain>
Aug 01 17:20:05 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078382299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078382299',id=44,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+P0Qb9g3aA1lqgIZiwJJznmzI6niZsbVwOJY8wqivVz8g1jeoGncxrmbZiKAcslbRKs5vKMTERUWg6cHM5zJv7SFpToZsQ5pprTjq7Tun6z10zbwFwXKG6lok/djrprw==',key_name='tempest-keypair-1732064922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-hbm38lhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=904e24fe-feb4-4349-a9ce-f5921745b35c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG os_vif [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbf7b7c-dc, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fbf7b7c-dc, col_values=(('external_ids', {'iface-id': '8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:7f:87', 'vm-uuid': '904e24fe-feb4-4349-a9ce-f5921745b35c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:05 user nova-compute[72184]: INFO os_vif [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc')
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:20:05 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No VIF found with MAC fa:16:3e:7e:7f:87, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:20:06 user nova-compute[72184]: DEBUG nova.network.neutron [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updated VIF entry in instance network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:20:06 user nova-compute[72184]: DEBUG nova.network.neutron [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eebc50d4-6818-42a6-96e0-c2d2b728b9b3 req-9d7826c7-b0a5-4b8f-a755-706bfd0e9499 service nova] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-f7f586ee-1224-4718-9d79-dd35f6b463ee req-0e79b8a5-854e-41dd-a4a7-1e076a6da6e1 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f7f586ee-1224-4718-9d79-dd35f6b463ee req-0e79b8a5-854e-41dd-a4a7-1e076a6da6e1 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f7f586ee-1224-4718-9d79-dd35f6b463ee req-0e79b8a5-854e-41dd-a4a7-1e076a6da6e1 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f7f586ee-1224-4718-9d79-dd35f6b463ee req-0e79b8a5-854e-41dd-a4a7-1e076a6da6e1 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-f7f586ee-1224-4718-9d79-dd35f6b463ee req-0e79b8a5-854e-41dd-a4a7-1e076a6da6e1 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:07 user nova-compute[72184]: WARNING nova.compute.manager [req-f7f586ee-1224-4718-9d79-dd35f6b463ee req-0e79b8a5-854e-41dd-a4a7-1e076a6da6e1 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state building and task_state spawning.
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:07 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:08 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8738MB free_disk=25.30837631225586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 904e24fe-feb4-4349-a9ce-f5921745b35c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:20:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910409.226922, 904e24fe-feb4-4349-a9ce-f5921745b35c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] VM Resumed (Lifecycle Event)
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance spawned successfully.
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910409.2282012, 904e24fe-feb4-4349-a9ce-f5921745b35c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] VM Started (Lifecycle Event)
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-6ce6c845-ea46-4d60-be2a-4f030bc237b4 req-209fc7a6-c44d-4faa-bc1c-7e3ebe9bbc34 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6ce6c845-ea46-4d60-be2a-4f030bc237b4 req-209fc7a6-c44d-4faa-bc1c-7e3ebe9bbc34 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6ce6c845-ea46-4d60-be2a-4f030bc237b4 req-209fc7a6-c44d-4faa-bc1c-7e3ebe9bbc34 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6ce6c845-ea46-4d60-be2a-4f030bc237b4 req-209fc7a6-c44d-4faa-bc1c-7e3ebe9bbc34 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG nova.compute.manager [req-6ce6c845-ea46-4d60-be2a-4f030bc237b4 req-209fc7a6-c44d-4faa-bc1c-7e3ebe9bbc34 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:09 user nova-compute[72184]: WARNING nova.compute.manager [req-6ce6c845-ea46-4d60-be2a-4f030bc237b4 req-209fc7a6-c44d-4faa-bc1c-7e3ebe9bbc34 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state building and task_state spawning.
Aug 01 17:20:09 user nova-compute[72184]: INFO nova.compute.manager [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Took 6.15 seconds to build instance.
Aug 01 17:20:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28c2074a-7c90-4f6c-b0e7-b3e06e27e99c tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.239s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:15 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:15 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:20:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:20:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "45365011-819c-4787-8225-7e3abaac8d9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:20:18 user nova-compute[72184]: INFO nova.compute.claims [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Claim successful on node user
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:20:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:20:18 user nova-compute[72184]: INFO nova.virt.block_device [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Booting with volume 1e46f08e-a499-4ded-b913-6561d1ffd577 at /dev/vda
Aug 01 17:20:18 user nova-compute[72184]: DEBUG nova.policy [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce144879b7e4638822f0d7174693575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf5145289cf4667b9398df4a8266bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG os_brick.utils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8118a680-37ed-45ba-b7c2-ae818509e8d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0576e-a915-48ba-80d7-b38a472dfada]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f18a5e-6828-4a9f-ac8f-1edeb47f6cc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed2dcd-d86a-4b2e-a4e0-046dc805ff01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:20:19 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eea4d17-2781-41da-ab65-0f85aed50a30]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG os_brick.utils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating existing volume attachment record: 5beaa8bc-8ce0-4674-894c-4e9dd4cd368c {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Successfully created port: 13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:20:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Successfully updated port: 13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquired lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-changed-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Refreshing instance network info cache due to event network-changed-13d5745d-295e-477f-94b1-80a904f22123. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] Acquiring lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Releasing lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Instance network_info: |[{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] Acquired lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Refreshing network info cache for port 13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:20:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:20:21 user nova-compute[72184]: DEBUG nova.network.neutron [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updated VIF entry in instance network info cache for port 13d5745d-295e-477f-94b1-80a904f22123. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:20:21 user nova-compute[72184]: DEBUG nova.network.neutron [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-5379b901-a421-4a97-8fd4-12ef6a4c3034 req-6c44ce6f-3fee-4592-a95d-bd657d7e99c1 service nova] Releasing lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:20:26 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Creating image(s)
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Ensure instance console log exists: /opt/stack/data/nova/instances/45365011-819c-4787-8225-7e3abaac8d9e/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Start _get_guest_xml network_info=[{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '5beaa8bc-8ce0-4674-894c-4e9dd4cd368c', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45365011-819c-4787-8225-7e3abaac8d9e', 'attached_at': '', 'detached_at': '', 'volume_id': '1e46f08e-a499-4ded-b913-6561d1ffd577', 'serial': '1e46f08e-a499-4ded-b913-6561d1ffd577'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:20:26 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:26 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:20:26 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:20:26 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:20:26 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c9460-f206-4163-b780-6a7ba072a916]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:20:26 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4646743c-fa8d-40ad-9881-d7b09a34e1eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577] added
Aug 01 17:20:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[469561dc-75bf-4181-803e-b90aa112a76f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[995db9f7-c305-4018-a8a8-194d978bca9c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLmkNtVX {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLmkNtVX" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[873346d0-4260-41a1-8568-bfa4509a628c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aLmkNtVX'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[61506c32-e410-4a78-a2d1-8a03a5b3bfc4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7e6fe-dd05-4509-a9db-b9668045af0d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:20:26 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:20:26 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:20:26 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:20:26 user nova-compute[72184]: 
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39a563-93ad-403c-8c0c-51d523c9c12d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]
Aug 01 17:20:26 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.
Aug 01 17:20:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2242ef-9828-47e3-af94-31c44b89155d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d992d5a9-d4c5-4028-b6f0-9455fdb6902c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:20:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:20:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b3bb8-577b-4925-b9ad-22e1f1c73906]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26138323735343637', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138323735343637', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-823164968',display_name='tempest-TestVolumeBootPattern-server-823164968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-823164968',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-9r4y13fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:20:19Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=45365011-819c-4787-8225-7e3abaac8d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'pci_devices' on Instance uuid 45365011-819c-4787-8225-7e3abaac8d9e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:20:27 user nova-compute[72184]:   <uuid>45365011-819c-4787-8225-7e3abaac8d9e</uuid>
Aug 01 17:20:27 user nova-compute[72184]:   <name>instance-0000002d</name>
Aug 01 17:20:27 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:20:27 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:20:27 user nova-compute[72184]:   <metadata>
Aug 01 17:20:27 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:20:27 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:20:27 user nova-compute[72184]:       <nova:name>tempest-TestVolumeBootPattern-server-823164968</nova:name>
Aug 01 17:20:27 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:20:26</nova:creationTime>
Aug 01 17:20:27 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:20:27 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:20:27 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:20:27 user nova-compute[72184]:       <nova:owner>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:user uuid="9ce144879b7e4638822f0d7174693575">tempest-TestVolumeBootPattern-1490009883-project-member</nova:user>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:project uuid="7cf5145289cf4667b9398df4a8266bb4">tempest-TestVolumeBootPattern-1490009883</nova:project>
Aug 01 17:20:27 user nova-compute[72184]:       </nova:owner>
Aug 01 17:20:27 user nova-compute[72184]:       <nova:ports>
Aug 01 17:20:27 user nova-compute[72184]:         <nova:port uuid="13d5745d-295e-477f-94b1-80a904f22123">
Aug 01 17:20:27 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 17:20:27 user nova-compute[72184]:         </nova:port>
Aug 01 17:20:27 user nova-compute[72184]:       </nova:ports>
Aug 01 17:20:27 user nova-compute[72184]:     </nova:instance>
Aug 01 17:20:27 user nova-compute[72184]:   </metadata>
Aug 01 17:20:27 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:20:27 user nova-compute[72184]:     <system>
Aug 01 17:20:27 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:20:27 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:20:27 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:20:27 user nova-compute[72184]:       <entry name="serial">45365011-819c-4787-8225-7e3abaac8d9e</entry>
Aug 01 17:20:27 user nova-compute[72184]:       <entry name="uuid">45365011-819c-4787-8225-7e3abaac8d9e</entry>
Aug 01 17:20:27 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:20:27 user nova-compute[72184]:     </system>
Aug 01 17:20:27 user nova-compute[72184]:   </sysinfo>
Aug 01 17:20:27 user nova-compute[72184]:   <os>
Aug 01 17:20:27 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:20:27 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:20:27 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:20:27 user nova-compute[72184]:   </os>
Aug 01 17:20:27 user nova-compute[72184]:   <features>
Aug 01 17:20:27 user nova-compute[72184]:     <acpi/>
Aug 01 17:20:27 user nova-compute[72184]:     <apic/>
Aug 01 17:20:27 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:20:27 user nova-compute[72184]:   </features>
Aug 01 17:20:27 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:20:27 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:20:27 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:20:27 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:20:27 user nova-compute[72184]:   </clock>
Aug 01 17:20:27 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:20:27 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:20:27 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:20:27 user nova-compute[72184]:   </cpu>
Aug 01 17:20:27 user nova-compute[72184]:   <devices>
Aug 01 17:20:27 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:20:27 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:20:27 user nova-compute[72184]:       <source dev="/dev/sdb"/>
Aug 01 17:20:27 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:20:27 user nova-compute[72184]:       <serial>1e46f08e-a499-4ded-b913-6561d1ffd577</serial>
Aug 01 17:20:27 user nova-compute[72184]:     </disk>
Aug 01 17:20:27 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:20:27 user nova-compute[72184]:       <mac address="fa:16:3e:0f:9f:77"/>
Aug 01 17:20:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:27 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:20:27 user nova-compute[72184]:       <target dev="tap13d5745d-29"/>
Aug 01 17:20:27 user nova-compute[72184]:     </interface>
Aug 01 17:20:27 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:20:27 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/45365011-819c-4787-8225-7e3abaac8d9e/console.log" append="off"/>
Aug 01 17:20:27 user nova-compute[72184]:     </serial>
Aug 01 17:20:27 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:20:27 user nova-compute[72184]:     <video>
Aug 01 17:20:27 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:27 user nova-compute[72184]:     </video>
Aug 01 17:20:27 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:20:27 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:20:27 user nova-compute[72184]:     </rng>
Aug 01 17:20:27 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:20:27 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:20:27 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:20:27 user nova-compute[72184]:     </memballoon>
Aug 01 17:20:27 user nova-compute[72184]:   </devices>
Aug 01 17:20:27 user nova-compute[72184]: </domain>
Aug 01 17:20:27 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-823164968',display_name='tempest-TestVolumeBootPattern-server-823164968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-823164968',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-9r4y13fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:20:19Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=45365011-819c-4787-8225-7e3abaac8d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG os_vif [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13d5745d-29, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13d5745d-29, col_values=(('external_ids', {'iface-id': '13d5745d-295e-477f-94b1-80a904f22123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:9f:77', 'vm-uuid': '45365011-819c-4787-8225-7e3abaac8d9e'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:27 user nova-compute[72184]: INFO os_vif [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29')
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:20:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No VIF found with MAC fa:16:3e:0f:9f:77, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:20:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-daf24ae2-3e05-4f53-ac8e-a9379ec33c69 req-1176396f-563e-48b8-ab98-24f326a43efe service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-daf24ae2-3e05-4f53-ac8e-a9379ec33c69 req-1176396f-563e-48b8-ab98-24f326a43efe service nova] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-daf24ae2-3e05-4f53-ac8e-a9379ec33c69 req-1176396f-563e-48b8-ab98-24f326a43efe service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-daf24ae2-3e05-4f53-ac8e-a9379ec33c69 req-1176396f-563e-48b8-ab98-24f326a43efe service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-daf24ae2-3e05-4f53-ac8e-a9379ec33c69 req-1176396f-563e-48b8-ab98-24f326a43efe service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] No waiting events found dispatching network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:29 user nova-compute[72184]: WARNING nova.compute.manager [req-daf24ae2-3e05-4f53-ac8e-a9379ec33c69 req-1176396f-563e-48b8-ab98-24f326a43efe service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received unexpected event network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 for instance with vm_state building and task_state spawning.
Aug 01 17:20:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910431.1310048, 45365011-819c-4787-8225-7e3abaac8d9e => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] VM Resumed (Lifecycle Event)
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Instance spawned successfully.
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-d2980dae-417e-4f01-8123-c35a26299e7c req-bdb2d149-2db1-4296-9e8a-ebd717558802 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d2980dae-417e-4f01-8123-c35a26299e7c req-bdb2d149-2db1-4296-9e8a-ebd717558802 service nova] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d2980dae-417e-4f01-8123-c35a26299e7c req-bdb2d149-2db1-4296-9e8a-ebd717558802 service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d2980dae-417e-4f01-8123-c35a26299e7c req-bdb2d149-2db1-4296-9e8a-ebd717558802 service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-d2980dae-417e-4f01-8123-c35a26299e7c req-bdb2d149-2db1-4296-9e8a-ebd717558802 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] No waiting events found dispatching network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:31 user nova-compute[72184]: WARNING nova.compute.manager [req-d2980dae-417e-4f01-8123-c35a26299e7c req-bdb2d149-2db1-4296-9e8a-ebd717558802 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received unexpected event network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 for instance with vm_state building and task_state spawning.
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910431.1380866, 45365011-819c-4787-8225-7e3abaac8d9e => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] VM Started (Lifecycle Event)
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 01 17:20:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:31 user nova-compute[72184]: INFO nova.compute.manager [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Took 12.78 seconds to build instance.
Aug 01 17:20:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0638fc63-5635-468e-8d8e-588f2f29cf19 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "45365011-819c-4787-8225-7e3abaac8d9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.886s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:37 user nova-compute[72184]: INFO nova.compute.manager [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Unshelving
Aug 01 17:20:37 user nova-compute[72184]: INFO nova.virt.block_device [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Booting with volume eaa0d8a0-7b05-472d-a489-88a893fb7bd3 at /dev/vda
Aug 01 17:20:37 user nova-compute[72184]: DEBUG os_brick.utils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e8215-aca5-4c1e-b40d-56b4b0e48a91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[695884d0-1f5d-4e19-994d-cfc1c6a8e6f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10631673-a3f9-4a06-8e42-085a989a0c3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b650d30b-b95c-44b5-b616-1f64dfb2f134]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:20:37 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf0dfeb-4116-4e76-b5d5-90f1d4474ae7]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG os_brick.utils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating existing volume attachment record: 88c671d5-8d6b-49f4-9680-49bb2a904f4c {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:37 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:20:37 user nova-compute[72184]: INFO nova.compute.claims [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Claim successful on node user
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:20:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.policy [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5af08a5f7d46bdb7512360bcae3905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88373a3db0cb453b99f922d0a1a31781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:20:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Creating image(s)
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "/opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "/opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk 1073741824" returned: 0 in 0.059s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:20:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Successfully created port: 256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Cannot resize image /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'migration_context' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Ensure instance console log exists: /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Successfully updated port: 256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquired lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-changed-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Refreshing instance network info cache due to event network-changed-256b2df4-273e-4422-920d-2f237f584bfd. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] Acquiring lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:39 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updating instance_info_cache with network_info: [{"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Releasing lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Instance network_info: |[{"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] Acquired lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Refreshing network info cache for port 256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Start _get_guest_xml network_info=[{"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:20:40 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:40 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1559339955',display_name='tempest-AttachVolumeTestJSON-server-1559339955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1559339955',id=46,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6gg/w7RX9CSmA21p/bmMsF5f4DWttaGYsJ6F8J/RSYuMwbgXxivewORZwIN3QNpxh5Cv5BzCuMTdZOMXzA0wImatE/R6c+MUuoQcJRzXxIlqMt4lqg+Mpg6qbKSKr51A==',key_name='tempest-keypair-574732242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-ts9hs0a1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:20:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=e0931984-d881-4f17-97cf-3e4895bec1e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'pci_devices' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:20:40 user nova-compute[72184]:   <uuid>e0931984-d881-4f17-97cf-3e4895bec1e2</uuid>
Aug 01 17:20:40 user nova-compute[72184]:   <name>instance-0000002e</name>
Aug 01 17:20:40 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:20:40 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:20:40 user nova-compute[72184]:   <metadata>
Aug 01 17:20:40 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:20:40 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:20:40 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeTestJSON-server-1559339955</nova:name>
Aug 01 17:20:40 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:20:40</nova:creationTime>
Aug 01 17:20:40 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:20:40 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:20:40 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:20:40 user nova-compute[72184]:       <nova:owner>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:user uuid="6a5af08a5f7d46bdb7512360bcae3905">tempest-AttachVolumeTestJSON-984518084-project-member</nova:user>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:project uuid="88373a3db0cb453b99f922d0a1a31781">tempest-AttachVolumeTestJSON-984518084</nova:project>
Aug 01 17:20:40 user nova-compute[72184]:       </nova:owner>
Aug 01 17:20:40 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:20:40 user nova-compute[72184]:       <nova:ports>
Aug 01 17:20:40 user nova-compute[72184]:         <nova:port uuid="256b2df4-273e-4422-920d-2f237f584bfd">
Aug 01 17:20:40 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 17:20:40 user nova-compute[72184]:         </nova:port>
Aug 01 17:20:40 user nova-compute[72184]:       </nova:ports>
Aug 01 17:20:40 user nova-compute[72184]:     </nova:instance>
Aug 01 17:20:40 user nova-compute[72184]:   </metadata>
Aug 01 17:20:40 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:20:40 user nova-compute[72184]:     <system>
Aug 01 17:20:40 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:20:40 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:20:40 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:20:40 user nova-compute[72184]:       <entry name="serial">e0931984-d881-4f17-97cf-3e4895bec1e2</entry>
Aug 01 17:20:40 user nova-compute[72184]:       <entry name="uuid">e0931984-d881-4f17-97cf-3e4895bec1e2</entry>
Aug 01 17:20:40 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:20:40 user nova-compute[72184]:     </system>
Aug 01 17:20:40 user nova-compute[72184]:   </sysinfo>
Aug 01 17:20:40 user nova-compute[72184]:   <os>
Aug 01 17:20:40 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:20:40 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:20:40 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:20:40 user nova-compute[72184]:   </os>
Aug 01 17:20:40 user nova-compute[72184]:   <features>
Aug 01 17:20:40 user nova-compute[72184]:     <acpi/>
Aug 01 17:20:40 user nova-compute[72184]:     <apic/>
Aug 01 17:20:40 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:20:40 user nova-compute[72184]:   </features>
Aug 01 17:20:40 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:20:40 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:20:40 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:20:40 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:20:40 user nova-compute[72184]:   </clock>
Aug 01 17:20:40 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:20:40 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:20:40 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:20:40 user nova-compute[72184]:   </cpu>
Aug 01 17:20:40 user nova-compute[72184]:   <devices>
Aug 01 17:20:40 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:20:40 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:20:40 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk"/>
Aug 01 17:20:40 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:20:40 user nova-compute[72184]:     </disk>
Aug 01 17:20:40 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:20:40 user nova-compute[72184]:       <mac address="fa:16:3e:89:4d:24"/>
Aug 01 17:20:40 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:40 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:20:40 user nova-compute[72184]:       <target dev="tap256b2df4-27"/>
Aug 01 17:20:40 user nova-compute[72184]:     </interface>
Aug 01 17:20:40 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:20:40 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/console.log" append="off"/>
Aug 01 17:20:40 user nova-compute[72184]:     </serial>
Aug 01 17:20:40 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:20:40 user nova-compute[72184]:     <video>
Aug 01 17:20:40 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:40 user nova-compute[72184]:     </video>
Aug 01 17:20:40 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:20:40 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:20:40 user nova-compute[72184]:     </rng>
Aug 01 17:20:40 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:20:40 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:20:40 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:20:40 user nova-compute[72184]:     </memballoon>
Aug 01 17:20:40 user nova-compute[72184]:   </devices>
Aug 01 17:20:40 user nova-compute[72184]: </domain>
Aug 01 17:20:40 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1559339955',display_name='tempest-AttachVolumeTestJSON-server-1559339955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1559339955',id=46,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6gg/w7RX9CSmA21p/bmMsF5f4DWttaGYsJ6F8J/RSYuMwbgXxivewORZwIN3QNpxh5Cv5BzCuMTdZOMXzA0wImatE/R6c+MUuoQcJRzXxIlqMt4lqg+Mpg6qbKSKr51A==',key_name='tempest-keypair-574732242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-ts9hs0a1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:20:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=e0931984-d881-4f17-97cf-3e4895bec1e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG os_vif [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap256b2df4-27, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap256b2df4-27, col_values=(('external_ids', {'iface-id': '256b2df4-273e-4422-920d-2f237f584bfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:4d:24', 'vm-uuid': 'e0931984-d881-4f17-97cf-3e4895bec1e2'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:40 user nova-compute[72184]: INFO os_vif [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27')
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:20:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No VIF found with MAC fa:16:3e:89:4d:24, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:20:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updated VIF entry in instance network info cache for port 256b2df4-273e-4422-920d-2f237f584bfd. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:20:41 user nova-compute[72184]: DEBUG nova.network.neutron [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updating instance_info_cache with network_info: [{"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-648f4e0c-5817-4b78-8390-baec01a6085a req-a8dbaad6-a420-41d7-ae9b-2d9767977545 service nova] Releasing lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-e1b88bd2-1399-4186-8e7a-8e640d8f1c03 req-69445a63-d15b-4fcf-bfa0-5a81d787a96c service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e1b88bd2-1399-4186-8e7a-8e640d8f1c03 req-69445a63-d15b-4fcf-bfa0-5a81d787a96c service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e1b88bd2-1399-4186-8e7a-8e640d8f1c03 req-69445a63-d15b-4fcf-bfa0-5a81d787a96c service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e1b88bd2-1399-4186-8e7a-8e640d8f1c03 req-69445a63-d15b-4fcf-bfa0-5a81d787a96c service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-e1b88bd2-1399-4186-8e7a-8e640d8f1c03 req-69445a63-d15b-4fcf-bfa0-5a81d787a96c service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:42 user nova-compute[72184]: WARNING nova.compute.manager [req-e1b88bd2-1399-4186-8e7a-8e640d8f1c03 req-69445a63-d15b-4fcf-bfa0-5a81d787a96c service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received unexpected event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with vm_state building and task_state spawning.
Aug 01 17:20:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-ace3b643-c757-47ab-a957-43c6db4ffcc7 req-f6c16d70-72bb-489a-a8cb-37676677713b service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ace3b643-c757-47ab-a957-43c6db4ffcc7 req-f6c16d70-72bb-489a-a8cb-37676677713b service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ace3b643-c757-47ab-a957-43c6db4ffcc7 req-f6c16d70-72bb-489a-a8cb-37676677713b service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ace3b643-c757-47ab-a957-43c6db4ffcc7 req-f6c16d70-72bb-489a-a8cb-37676677713b service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-ace3b643-c757-47ab-a957-43c6db4ffcc7 req-f6c16d70-72bb-489a-a8cb-37676677713b service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:44 user nova-compute[72184]: WARNING nova.compute.manager [req-ace3b643-c757-47ab-a957-43c6db4ffcc7 req-f6c16d70-72bb-489a-a8cb-37676677713b service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received unexpected event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with vm_state building and task_state spawning.
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910444.5900552, e0931984-d881-4f17-97cf-3e4895bec1e2 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] VM Resumed (Lifecycle Event)
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Instance spawned successfully.
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910444.5915022, e0931984-d881-4f17-97cf-3e4895bec1e2 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] VM Started (Lifecycle Event)
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Took 6.35 seconds to spawn the instance on the hypervisor.
Aug 01 17:20:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:44 user nova-compute[72184]: INFO nova.compute.manager [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Took 6.97 seconds to build instance.
Aug 01 17:20:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9cf35135-f082-471c-b2fe-27598be23c18 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.079s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'pci_requests' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'numa_topology' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:20:45 user nova-compute[72184]: INFO nova.compute.claims [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Claim successful on node user
Aug 01 17:20:45 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:45 user nova-compute[72184]: INFO nova.network.neutron [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating port 95f6c24c-d159-479b-9ff2-6539a254d388 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 17:20:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.network.neutron [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.compute.manager [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing instance network info cache due to event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.network.neutron [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:20:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Creating image(s)
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Ensure instance console log exists: /opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Start _get_guest_xml network_info=[{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '88c671d5-8d6b-49f4-9680-49bb2a904f4c', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7d35dee-22ac-440b-8a9e-994831bbc55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaa0d8a0-7b05-472d-a489-88a893fb7bd3', 'serial': 'eaa0d8a0-7b05-472d-a489-88a893fb7bd3'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:20:46 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:46 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:20:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:20:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:20:46 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf0bfa5-7088-403f-9ad1-90bf803eb56d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:20:46 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9aa3d-8532-4427-82f8-7ae20c6bdf7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3] added
Aug 01 17:20:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[666546ec-0c5d-44a8-a275-2c9ac09fa8b3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75faaa33-1890-4216-be01-86cc6e9528eb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsgBikFP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsgBikFP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f45e78-4b3c-4705-9178-31af74d6b294]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsgBikFP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5347cf1d-c899-4a34-bcd6-478455c3577e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfcb610-0310-4ceb-937d-fd2cd3d549a7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:20:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:20:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc060d-a8d1-43e3-a87d-093791c66dbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]
Aug 01 17:20:46 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.
Aug 01 17:20:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2149c99c-2648-42ac-8412-a657c8983b95]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d6e82a-cf0c-4f93-b3ac-353d022cc9ea]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:20:47 user nova-compute[72184]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:20:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:20:47 user nova-compute[72184]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:20:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[101a0bd0-ed34-4c34-aa6f-e3ae4fa31e37]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG nova.network.neutron [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updated VIF entry in instance network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG nova.network.neutron [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:20:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8afc9b20-0c18-41d9-87bf-54c5036c7181 req-5c4d9d25-49b2-428d-9567-4e4f23228664 service nova] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23261366532316435', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366532316435', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1057693331',display_name='tempest-TestShelveInstance-server-1057693331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1057693331',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-811487968',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e27e54f115ee4626a138b42169a64b31',ramdisk_id='',reservation_id='r-c94jav0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-892605189',owner_user_name='tempest-TestShelveInstance-892605189-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:20:37Z,user_data=None,user_id='4174219695504fc4bae42cb9c2aff01d',uuid=c7d35dee-22ac-440b-8a9e-994831bbc55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converting VIF {"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'pci_devices' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:20:48 user nova-compute[72184]:   <uuid>c7d35dee-22ac-440b-8a9e-994831bbc55c</uuid>
Aug 01 17:20:48 user nova-compute[72184]:   <name>instance-0000002a</name>
Aug 01 17:20:48 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:20:48 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:20:48 user nova-compute[72184]:   <metadata>
Aug 01 17:20:48 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:20:48 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:20:48 user nova-compute[72184]:       <nova:name>tempest-TestShelveInstance-server-1057693331</nova:name>
Aug 01 17:20:48 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:20:46</nova:creationTime>
Aug 01 17:20:48 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:20:48 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:20:48 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:20:48 user nova-compute[72184]:       <nova:owner>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:user uuid="4174219695504fc4bae42cb9c2aff01d">tempest-TestShelveInstance-892605189-project-member</nova:user>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:project uuid="e27e54f115ee4626a138b42169a64b31">tempest-TestShelveInstance-892605189</nova:project>
Aug 01 17:20:48 user nova-compute[72184]:       </nova:owner>
Aug 01 17:20:48 user nova-compute[72184]:       <nova:ports>
Aug 01 17:20:48 user nova-compute[72184]:         <nova:port uuid="95f6c24c-d159-479b-9ff2-6539a254d388">
Aug 01 17:20:48 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 17:20:48 user nova-compute[72184]:         </nova:port>
Aug 01 17:20:48 user nova-compute[72184]:       </nova:ports>
Aug 01 17:20:48 user nova-compute[72184]:     </nova:instance>
Aug 01 17:20:48 user nova-compute[72184]:   </metadata>
Aug 01 17:20:48 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:20:48 user nova-compute[72184]:     <system>
Aug 01 17:20:48 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:20:48 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:20:48 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:20:48 user nova-compute[72184]:       <entry name="serial">c7d35dee-22ac-440b-8a9e-994831bbc55c</entry>
Aug 01 17:20:48 user nova-compute[72184]:       <entry name="uuid">c7d35dee-22ac-440b-8a9e-994831bbc55c</entry>
Aug 01 17:20:48 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:20:48 user nova-compute[72184]:     </system>
Aug 01 17:20:48 user nova-compute[72184]:   </sysinfo>
Aug 01 17:20:48 user nova-compute[72184]:   <os>
Aug 01 17:20:48 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:20:48 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:20:48 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:20:48 user nova-compute[72184]:   </os>
Aug 01 17:20:48 user nova-compute[72184]:   <features>
Aug 01 17:20:48 user nova-compute[72184]:     <acpi/>
Aug 01 17:20:48 user nova-compute[72184]:     <apic/>
Aug 01 17:20:48 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:20:48 user nova-compute[72184]:   </features>
Aug 01 17:20:48 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:20:48 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:20:48 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:20:48 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:20:48 user nova-compute[72184]:   </clock>
Aug 01 17:20:48 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:20:48 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:20:48 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:20:48 user nova-compute[72184]:   </cpu>
Aug 01 17:20:48 user nova-compute[72184]:   <devices>
Aug 01 17:20:48 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:20:48 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:20:48 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:20:48 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:20:48 user nova-compute[72184]:       <serial>eaa0d8a0-7b05-472d-a489-88a893fb7bd3</serial>
Aug 01 17:20:48 user nova-compute[72184]:     </disk>
Aug 01 17:20:48 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:20:48 user nova-compute[72184]:       <mac address="fa:16:3e:7b:3a:bf"/>
Aug 01 17:20:48 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:48 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:20:48 user nova-compute[72184]:       <target dev="tap95f6c24c-d1"/>
Aug 01 17:20:48 user nova-compute[72184]:     </interface>
Aug 01 17:20:48 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:20:48 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c/console.log" append="off"/>
Aug 01 17:20:48 user nova-compute[72184]:     </serial>
Aug 01 17:20:48 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:20:48 user nova-compute[72184]:     <video>
Aug 01 17:20:48 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:20:48 user nova-compute[72184]:     </video>
Aug 01 17:20:48 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:20:48 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:20:48 user nova-compute[72184]:     </rng>
Aug 01 17:20:48 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:20:48 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:20:48 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:20:48 user nova-compute[72184]:     </memballoon>
Aug 01 17:20:48 user nova-compute[72184]:   </devices>
Aug 01 17:20:48 user nova-compute[72184]: </domain>
Aug 01 17:20:48 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1057693331',display_name='tempest-TestShelveInstance-server-1057693331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1057693331',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-811487968',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e27e54f115ee4626a138b42169a64b31',ramdisk_id='',reservation_id='r-c94jav0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-892605189',owner_user_name='tempest-TestShelveInstance-892605189-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:20:37Z,user_data=None,user_id='4174219695504fc4bae42cb9c2aff01d',uuid=c7d35dee-22ac-440b-8a9e-994831bbc55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converting VIF {"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG os_vif [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95f6c24c-d1, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95f6c24c-d1, col_values=(('external_ids', {'iface-id': '95f6c24c-d159-479b-9ff2-6539a254d388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3a:bf', 'vm-uuid': 'c7d35dee-22ac-440b-8a9e-994831bbc55c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:48 user nova-compute[72184]: INFO os_vif [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1')
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:20:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] No VIF found with MAC fa:16:3e:7b:3a:bf, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG nova.compute.manager [req-c4d109c3-814f-44f0-85ab-f3f4a778a816 req-1785c19e-63a0-4102-b8f0-88b8a2387d99 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c4d109c3-814f-44f0-85ab-f3f4a778a816 req-1785c19e-63a0-4102-b8f0-88b8a2387d99 service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c4d109c3-814f-44f0-85ab-f3f4a778a816 req-1785c19e-63a0-4102-b8f0-88b8a2387d99 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c4d109c3-814f-44f0-85ab-f3f4a778a816 req-1785c19e-63a0-4102-b8f0-88b8a2387d99 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:49 user nova-compute[72184]: DEBUG nova.compute.manager [req-c4d109c3-814f-44f0-85ab-f3f4a778a816 req-1785c19e-63a0-4102-b8f0-88b8a2387d99 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:49 user nova-compute[72184]: WARNING nova.compute.manager [req-c4d109c3-814f-44f0-85ab-f3f4a778a816 req-1785c19e-63a0-4102-b8f0-88b8a2387d99 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 17:20:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910451.545523, c7d35dee-22ac-440b-8a9e-994831bbc55c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:51 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] VM Resumed (Lifecycle Event)
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:20:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance spawned successfully.
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:51 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910451.546494, c7d35dee-22ac-440b-8a9e-994831bbc55c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:20:51 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] VM Started (Lifecycle Event)
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2626f862-cca3-4e15-bac5-1c7015d5ca24 tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.307s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-2eb7ccc4-0c53-4d38-9176-130783ea7115 req-e83e5cee-4298-4d1a-8a5f-6b9a2f8ca857 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2eb7ccc4-0c53-4d38-9176-130783ea7115 req-e83e5cee-4298-4d1a-8a5f-6b9a2f8ca857 service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2eb7ccc4-0c53-4d38-9176-130783ea7115 req-e83e5cee-4298-4d1a-8a5f-6b9a2f8ca857 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2eb7ccc4-0c53-4d38-9176-130783ea7115 req-e83e5cee-4298-4d1a-8a5f-6b9a2f8ca857 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:20:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-2eb7ccc4-0c53-4d38-9176-130783ea7115 req-e83e5cee-4298-4d1a-8a5f-6b9a2f8ca857 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:20:51 user nova-compute[72184]: WARNING nova.compute.manager [req-2eb7ccc4-0c53-4d38-9176-130783ea7115 req-e83e5cee-4298-4d1a-8a5f-6b9a2f8ca857 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state active and task_state None.
Aug 01 17:20:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:20:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:06 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:21:10 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:21:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:21:11 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8137MB free_disk=25.248531341552734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 904e24fe-feb4-4349-a9ce-f5921745b35c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 45365011-819c-4787-8225-7e3abaac8d9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance c7d35dee-22ac-440b-8a9e-994831bbc55c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e0931984-d881-4f17-97cf-3e4895bec1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:21:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:21:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:15 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:21:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:21:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:21:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:21:23 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:21:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:21:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:21:53 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG nova.compute.manager [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing instance network info cache due to event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updated VIF entry in instance network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f1824898-206a-43ec-9a50-74348aca8db9 req-660ac8d3-6f1f-4a2c-ba49-32da2eead0cf service nova] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:21:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:21:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:21:58 user nova-compute[72184]: INFO nova.compute.manager [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Shelving
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c3a8ce1-b551-46d5-908e-1e22644a7747 req-dc7aa991-363e-43dc-85cc-ab4d4d23bc6c service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c3a8ce1-b551-46d5-908e-1e22644a7747 req-dc7aa991-363e-43dc-85cc-ab4d4d23bc6c service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c3a8ce1-b551-46d5-908e-1e22644a7747 req-dc7aa991-363e-43dc-85cc-ab4d4d23bc6c service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c3a8ce1-b551-46d5-908e-1e22644a7747 req-dc7aa991-363e-43dc-85cc-ab4d4d23bc6c service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c3a8ce1-b551-46d5-908e-1e22644a7747 req-dc7aa991-363e-43dc-85cc-ab4d4d23bc6c service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:21:59 user nova-compute[72184]: WARNING nova.compute.manager [req-9c3a8ce1-b551-46d5-908e-1e22644a7747 req-dc7aa991-363e-43dc-85cc-ab4d4d23bc6c service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state active and task_state shelving.
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:21:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance destroyed successfully.
Aug 01 17:21:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Beginning cold snapshot process
Aug 01 17:22:00 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:22:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk /opt/stack/data/nova/instances/snapshots/tmpitfact_y/a3810afd9c1047cf98d557d8a202fc36 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk /opt/stack/data/nova/instances/snapshots/tmpitfact_y/a3810afd9c1047cf98d557d8a202fc36" returned: 0 in 0.498s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:00 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Snapshot extracted, beginning image upload
Aug 01 17:22:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-53b65f5f-3af7-4876-9abf-c9084cbac690 req-00492dbf-dacf-4c02-be32-eebd99d1df1d service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-53b65f5f-3af7-4876-9abf-c9084cbac690 req-00492dbf-dacf-4c02-be32-eebd99d1df1d service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-53b65f5f-3af7-4876-9abf-c9084cbac690 req-00492dbf-dacf-4c02-be32-eebd99d1df1d service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-53b65f5f-3af7-4876-9abf-c9084cbac690 req-00492dbf-dacf-4c02-be32-eebd99d1df1d service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:01 user nova-compute[72184]: DEBUG nova.compute.manager [req-53b65f5f-3af7-4876-9abf-c9084cbac690 req-00492dbf-dacf-4c02-be32-eebd99d1df1d service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:22:01 user nova-compute[72184]: WARNING nova.compute.manager [req-53b65f5f-3af7-4876-9abf-c9084cbac690 req-00492dbf-dacf-4c02-be32-eebd99d1df1d service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 17:22:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Snapshot image upload complete
Aug 01 17:22:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:03 user nova-compute[72184]: INFO nova.compute.manager [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Shelve offloading
Aug 01 17:22:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance destroyed successfully.
Aug 01 17:22:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:22:03 user nova-compute[72184]: DEBUG nova.network.neutron [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance destroyed successfully.
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'resources' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078382299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078382299',id=44,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+P0Qb9g3aA1lqgIZiwJJznmzI6niZsbVwOJY8wqivVz8g1jeoGncxrmbZiKAcslbRKs5vKMTERUWg6cHM5zJv7SFpToZsQ5pprTjq7Tun6z10zbwFwXKG6lok/djrprw==',key_name='tempest-keypair-1732064922',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-hbm38lhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member',shelved_at='2023-08-01T17:22:03.189044',shelved_host='user',shelved_image_id='0f882b18-2fa6-43d7-a707-fecc67ee4abd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=904e24fe-feb4-4349-a9ce-f5921745b35c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG os_vif [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbf7b7c-dc, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:22:04 user nova-compute[72184]: INFO os_vif [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc')
Aug 01 17:22:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Deleting instance files /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c_del
Aug 01 17:22:04 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Deletion of /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c_del complete
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing instance network info cache due to event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:22:04 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Deleted allocations for instance 904e24fe-feb4-4349-a9ce-f5921745b35c
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.objects.instance [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'numa_topology' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-8ac5ab9e-50ef-4fbf-b896-dbc4f31cc794 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.919s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updated VIF entry in instance network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG nova.network.neutron [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8a98405f-3394-43b7-9488-461d6819da16 req-a5880357-d7f8-4cd0-bea8-7f9e9a81db38 service nova] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:08 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-changed-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG nova.compute.manager [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Refreshing instance network info cache due to event network-changed-13d5745d-295e-477f-94b1-80a904f22123. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] Acquiring lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] Acquired lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Refreshing network info cache for port 13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updated VIF entry in instance network info cache for port 13d5745d-295e-477f-94b1-80a904f22123. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG nova.network.neutron [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:10 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e995b5b3-c756-4be9-b636-eb5a00b5dbd4 req-c5ef3db6-7733-4081-b1f9-df525bea8e52 service nova] Releasing lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:22:12 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:22:12 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=25.218460083007812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 45365011-819c-4787-8225-7e3abaac8d9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance c7d35dee-22ac-440b-8a9e-994831bbc55c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance e0931984-d881-4f17-97cf-3e4895bec1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:22:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:22:13 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:22:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:22:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:22:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:14 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910519.7658627, 904e24fe-feb4-4349-a9ce-f5921745b35c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:22:14 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] VM Stopped (Lifecycle Event)
Aug 01 17:22:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-565c4fcf-f33f-467f-bd83-2de6f2eca4cb None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:22:21 user nova-compute[72184]: INFO nova.compute.claims [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Claim successful on node user
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.network.neutron [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:22:21 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:22:21 user nova-compute[72184]: INFO nova.virt.block_device [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Booting with volume 864b8fda-c4a7-45d5-906b-90c6459cdbc4 at /dev/vda
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.policy [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce144879b7e4638822f0d7174693575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf5145289cf4667b9398df4a8266bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG os_brick.utils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2efc4-b35d-42a2-a8cd-5991ae38a279]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a40ff6-6242-43c6-9e4e-12032afbcbb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad827607-f484-43c9-b553-93d351a58623]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d52365-47de-4ad5-9efb-426466048cea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:22:21 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfcabd4-a512-4eba-82f7-615fbd25ade9]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG os_brick.utils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updating existing volume attachment record: 6c63b1fe-5372-4bc4-931c-743deda6ce08 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG nova.network.neutron [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Successfully created port: da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG nova.network.neutron [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Successfully updated port: da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquired lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG nova.network.neutron [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-changed-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Refreshing instance network info cache due to event network-changed-da7a56df-dd6c-4a63-89b7-b55db4501d5f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] Acquiring lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:22 user nova-compute[72184]: DEBUG nova.network.neutron [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG nova.network.neutron [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updating instance_info_cache with network_info: [{"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Releasing lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Instance network_info: |[{"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] Acquired lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG nova.network.neutron [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Refreshing network info cache for port da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG nova.network.neutron [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updated VIF entry in instance network info cache for port da7a56df-dd6c-4a63-89b7-b55db4501d5f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG nova.network.neutron [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updating instance_info_cache with network_info: [{"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a7d2c8f5-8ef6-463b-acca-d0351088e818 req-ffbd506b-7029-4959-b5fc-c2a5b12dd850 service nova] Releasing lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG nova.compute.manager [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing instance network info cache due to event network-changed-95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] Acquiring lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] Acquired lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG nova.network.neutron [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Refreshing network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:28 user nova-compute[72184]: INFO nova.compute.manager [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Terminating instance
Aug 01 17:22:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-af01feb1-8e63-463b-8287-e482e05da0d6 req-65c1c3c9-8d51-43e5-9c9b-45054767359e service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-unplugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af01feb1-8e63-463b-8287-e482e05da0d6 req-65c1c3c9-8d51-43e5-9c9b-45054767359e service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af01feb1-8e63-463b-8287-e482e05da0d6 req-65c1c3c9-8d51-43e5-9c9b-45054767359e service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-af01feb1-8e63-463b-8287-e482e05da0d6 req-65c1c3c9-8d51-43e5-9c9b-45054767359e service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-af01feb1-8e63-463b-8287-e482e05da0d6 req-65c1c3c9-8d51-43e5-9c9b-45054767359e service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-unplugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-af01feb1-8e63-463b-8287-e482e05da0d6 req-65c1c3c9-8d51-43e5-9c9b-45054767359e service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-unplugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updated VIF entry in instance network info cache for port 95f6c24c-d159-479b-9ff2-6539a254d388. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.network.neutron [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [{"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-9c8be451-19cb-4ed5-a23a-966959386024 req-27d7ca4c-329c-4c03-a921-77ddf7b98d2b service nova] Releasing lock "refresh_cache-c7d35dee-22ac-440b-8a9e-994831bbc55c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Instance destroyed successfully.
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.objects.instance [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lazy-loading 'resources' on Instance uuid c7d35dee-22ac-440b-8a9e-994831bbc55c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1057693331',display_name='tempest-TestShelveInstance-server-1057693331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1057693331',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYIBxkH1dfoBtkKcc+ujWV85mfifnLhQYJBWksWsovla7FlpasFj0E2UptyY4dj5F1LZWxhbmFwb1BALqN/KV70bJXwIRY1T2KhQ01diFBoJ9Ow9HEu9ujXf+zfICsRzw==',key_name='tempest-TestShelveInstance-811487968',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e27e54f115ee4626a138b42169a64b31',ramdisk_id='',reservation_id='r-c94jav0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-892605189',owner_user_name='tempest-TestShelveInstance-892605189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:20:52Z,user_data=None,user_id='4174219695504fc4bae42cb9c2aff01d',uuid=c7d35dee-22ac-440b-8a9e-994831bbc55c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converting VIF {"id": "95f6c24c-d159-479b-9ff2-6539a254d388", "address": "fa:16:3e:7b:3a:bf", "network": {"id": "6e360221-ff59-452c-9454-9187c2406a5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1096511899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e27e54f115ee4626a138b42169a64b31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f6c24c-d1", "ovs_interfaceid": "95f6c24c-d159-479b-9ff2-6539a254d388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_vif [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95f6c24c-d1, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:22:29 user nova-compute[72184]: INFO os_vif [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:bf,bridge_name='br-int',has_traffic_filtering=True,id=95f6c24c-d159-479b-9ff2-6539a254d388,network=Network(6e360221-ff59-452c-9454-9187c2406a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f6c24c-d1')
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsgBikFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:29 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[225db52e-5763-47a7-9e9f-6299c5b30778]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059819a-25cb-46a9-aa08-1fd81cf5fdaf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:29 user nova-compute[72184]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:22:29 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:29 user nova-compute[72184]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 (non-flash)
Aug 01 17:22:29 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30277d03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b5068-fc72-405a-aea4-cb50967985f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff470ea-cdba-476d-a402-600bc46a8df5]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5c540-d310-4daf-9669-203318855fd6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a37a63-7e20-449c-ae80-4a44da9a2d72]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec3becc-ee96-4ded-a69c-d013b0dcdd55]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6056b5-6294-43e9-8a54-f8569c8d4f4d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260]
Aug 01 17:22:29 user nova-compute[72184]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3, portal: 172.16.0.220,3260] successful.
Aug 01 17:22:29 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa0d8a0-7b05-472d-a489-88a893fb7bd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e287f5-b19f-440d-88ff-4c3fa233ff6d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] <== disconnect_volume: return (287ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:22:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Deleting instance files /opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c_del
Aug 01 17:22:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Deletion of /opt/stack/data/nova/instances/c7d35dee-22ac-440b-8a9e-994831bbc55c_del complete
Aug 01 17:22:29 user nova-compute[72184]: INFO nova.compute.manager [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 01 17:22:29 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:22:29 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:22:30 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:30 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Took 0.59 seconds to deallocate network for instance.
Aug 01 17:22:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-changed-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:30 user nova-compute[72184]: DEBUG nova.compute.manager [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Refreshing instance network info cache due to event network-changed-256b2df4-273e-4422-920d-2f237f584bfd. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:22:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] Acquiring lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:22:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] Acquired lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:22:30 user nova-compute[72184]: DEBUG nova.network.neutron [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Refreshing network info cache for port 256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] Acquiring lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] No waiting events found dispatching network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:22:31 user nova-compute[72184]: WARNING nova.compute.manager [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received unexpected event network-vif-plugged-95f6c24c-d159-479b-9ff2-6539a254d388 for instance with vm_state active and task_state deleting.
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.compute.manager [req-ee9eebba-1ea2-4afc-b431-d869caff2434 req-5e05ec55-bf72-450c-973a-16256753e4f5 service nova] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Received event network-vif-deleted-95f6c24c-d159-479b-9ff2-6539a254d388 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updated VIF entry in instance network info cache for port 256b2df4-273e-4422-920d-2f237f584bfd. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.network.neutron [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updating instance_info_cache with network_info: [{"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-97a0b23e-a7c0-4c00-87b3-2937e00ddc2d req-a165ac79-4353-4b4d-8dee-edbddc6109af service nova] Releasing lock "refresh_cache-e0931984-d881-4f17-97cf-3e4895bec1e2" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:22:31 user nova-compute[72184]: INFO nova.compute.manager [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Deleting volume: eaa0d8a0-7b05-472d-a489-88a893fb7bd3 {{(pid=72184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:31 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Deleted allocations for instance c7d35dee-22ac-440b-8a9e-994831bbc55c
Aug 01 17:22:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-985d7f8f-b57c-4c87-a84f-3f07ed2838da tempest-TestShelveInstance-892605189 tempest-TestShelveInstance-892605189-project-member] Lock "c7d35dee-22ac-440b-8a9e-994831bbc55c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:33 user nova-compute[72184]: INFO nova.compute.manager [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attaching volume 82c492e7-1542-44f0-abc6-9ea6f2b4fe7d to /dev/vdb
Aug 01 17:22:33 user nova-compute[72184]: DEBUG os_brick.utils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8115de-dbdd-4090-98d5-053b21b1c76f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb109c-cce3-480e-b1e9-859dfc819d1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17089da-c9d1-4ead-a389-a2608f1da274]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[421eaa47-dec2-49cd-b50e-f0660fee63e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:22:33 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:22:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d4a8fe-7d1b-4d37-8d82-b183affa3b38]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG os_brick.utils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:33 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updating existing volume attachment record: db071a81-26b5-4954-b050-e1f3a01fcebb {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:22:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Creating image(s)
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Did not create local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Ensure instance console log exists: /opt/stack/data/nova/instances/aaa9f081-9366-4493-b687-1698c6ee15d6/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Start _get_guest_xml network_info=[{"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '6c63b1fe-5372-4bc4-931c-743deda6ce08', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYuScbLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aaa9f081-9366-4493-b687-1698c6ee15d6', 'attached_at': '', 'detached_at': '', 'volume_id': '864b8fda-c4a7-45d5-906b-90c6459cdbc4', 'serial': '864b8fda-c4a7-45d5-906b-90c6459cdbc4'}, 'volume_type': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:22:34 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:22:34 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYuScbLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:34 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dad677-c9fb-406c-a93c-229495afd2ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:22:34 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f6e3e-47e0-439d-bbac-5ed386756708]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4] added
Aug 01 17:22:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd52698-17e1-41d3-a197-60c3040fc53c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae92f8-9201-4b08-88ec-6a56258c78be]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYuScbLy {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYuScbLy" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eef65b-2c55-4811-bae3-f92f58fa281a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EYuScbLy'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf081d97-272f-415f-b53b-83de1208dee5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a4833-9254-45e4-bfb4-952d1d4bec48]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46cdb4c-4717-4ddf-8536-f1cc817585fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260]
Aug 01 17:22:34 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260] successful.
Aug 01 17:22:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e298739-fd56-4c3f-92c7-17ea6ee3679d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c771799-7a3c-494c-a027-2ee234e377df]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:34 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:34 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52a24dc-9fe2-4558-b104-19304233c9b1]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:22:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYuScbLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23866303237613461', 'path': '/dev/sdc'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866303237613461', 'path': '/dev/sdc'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-331453455',display_name='tempest-TestVolumeBootPattern-server-331453455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-331453455',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-5p3akdaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:22:22Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=aaa9f081-9366-4493-b687-1698c6ee15d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'pci_devices' on Instance uuid aaa9f081-9366-4493-b687-1698c6ee15d6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:22:35 user nova-compute[72184]:   <uuid>aaa9f081-9366-4493-b687-1698c6ee15d6</uuid>
Aug 01 17:22:35 user nova-compute[72184]:   <name>instance-0000002f</name>
Aug 01 17:22:35 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:22:35 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:22:35 user nova-compute[72184]:   <metadata>
Aug 01 17:22:35 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:22:35 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:22:35 user nova-compute[72184]:       <nova:name>tempest-TestVolumeBootPattern-server-331453455</nova:name>
Aug 01 17:22:35 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:22:34</nova:creationTime>
Aug 01 17:22:35 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:22:35 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:22:35 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:22:35 user nova-compute[72184]:       <nova:owner>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:user uuid="9ce144879b7e4638822f0d7174693575">tempest-TestVolumeBootPattern-1490009883-project-member</nova:user>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:project uuid="7cf5145289cf4667b9398df4a8266bb4">tempest-TestVolumeBootPattern-1490009883</nova:project>
Aug 01 17:22:35 user nova-compute[72184]:       </nova:owner>
Aug 01 17:22:35 user nova-compute[72184]:       <nova:ports>
Aug 01 17:22:35 user nova-compute[72184]:         <nova:port uuid="da7a56df-dd6c-4a63-89b7-b55db4501d5f">
Aug 01 17:22:35 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 17:22:35 user nova-compute[72184]:         </nova:port>
Aug 01 17:22:35 user nova-compute[72184]:       </nova:ports>
Aug 01 17:22:35 user nova-compute[72184]:     </nova:instance>
Aug 01 17:22:35 user nova-compute[72184]:   </metadata>
Aug 01 17:22:35 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:22:35 user nova-compute[72184]:     <system>
Aug 01 17:22:35 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:22:35 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:22:35 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:22:35 user nova-compute[72184]:       <entry name="serial">aaa9f081-9366-4493-b687-1698c6ee15d6</entry>
Aug 01 17:22:35 user nova-compute[72184]:       <entry name="uuid">aaa9f081-9366-4493-b687-1698c6ee15d6</entry>
Aug 01 17:22:35 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:22:35 user nova-compute[72184]:     </system>
Aug 01 17:22:35 user nova-compute[72184]:   </sysinfo>
Aug 01 17:22:35 user nova-compute[72184]:   <os>
Aug 01 17:22:35 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:22:35 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:22:35 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:22:35 user nova-compute[72184]:   </os>
Aug 01 17:22:35 user nova-compute[72184]:   <features>
Aug 01 17:22:35 user nova-compute[72184]:     <acpi/>
Aug 01 17:22:35 user nova-compute[72184]:     <apic/>
Aug 01 17:22:35 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:22:35 user nova-compute[72184]:   </features>
Aug 01 17:22:35 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:22:35 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:22:35 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:22:35 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:22:35 user nova-compute[72184]:   </clock>
Aug 01 17:22:35 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:22:35 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:22:35 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:22:35 user nova-compute[72184]:   </cpu>
Aug 01 17:22:35 user nova-compute[72184]:   <devices>
Aug 01 17:22:35 user nova-compute[72184]:     <disk type="block" device="disk">
Aug 01 17:22:35 user nova-compute[72184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:35 user nova-compute[72184]:       <source dev="/dev/sdc"/>
Aug 01 17:22:35 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:22:35 user nova-compute[72184]:       <serial>864b8fda-c4a7-45d5-906b-90c6459cdbc4</serial>
Aug 01 17:22:35 user nova-compute[72184]:     </disk>
Aug 01 17:22:35 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:22:35 user nova-compute[72184]:       <mac address="fa:16:3e:e2:3c:b5"/>
Aug 01 17:22:35 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:22:35 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:22:35 user nova-compute[72184]:       <target dev="tapda7a56df-dd"/>
Aug 01 17:22:35 user nova-compute[72184]:     </interface>
Aug 01 17:22:35 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:22:35 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/aaa9f081-9366-4493-b687-1698c6ee15d6/console.log" append="off"/>
Aug 01 17:22:35 user nova-compute[72184]:     </serial>
Aug 01 17:22:35 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:22:35 user nova-compute[72184]:     <video>
Aug 01 17:22:35 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:22:35 user nova-compute[72184]:     </video>
Aug 01 17:22:35 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:22:35 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:22:35 user nova-compute[72184]:     </rng>
Aug 01 17:22:35 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:22:35 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:22:35 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:22:35 user nova-compute[72184]:     </memballoon>
Aug 01 17:22:35 user nova-compute[72184]:   </devices>
Aug 01 17:22:35 user nova-compute[72184]: </domain>
Aug 01 17:22:35 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-331453455',display_name='tempest-TestVolumeBootPattern-server-331453455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-331453455',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-5p3akdaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:22:22Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=aaa9f081-9366-4493-b687-1698c6ee15d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG os_vif [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda7a56df-dd, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda7a56df-dd, col_values=(('external_ids', {'iface-id': 'da7a56df-dd6c-4a63-89b7-b55db4501d5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:3c:b5', 'vm-uuid': 'aaa9f081-9366-4493-b687-1698c6ee15d6'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:35 user nova-compute[72184]: INFO os_vif [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd')
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:22:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] No VIF found with MAC fa:16:3e:e2:3c:b5, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-8a49dffd-4ee6-4a58-b4c4-801fb00f593b req-497f390b-8a1e-4451-a33e-2cae6520a76d service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8a49dffd-4ee6-4a58-b4c4-801fb00f593b req-497f390b-8a1e-4451-a33e-2cae6520a76d service nova] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8a49dffd-4ee6-4a58-b4c4-801fb00f593b req-497f390b-8a1e-4451-a33e-2cae6520a76d service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-8a49dffd-4ee6-4a58-b4c4-801fb00f593b req-497f390b-8a1e-4451-a33e-2cae6520a76d service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:37 user nova-compute[72184]: DEBUG nova.compute.manager [req-8a49dffd-4ee6-4a58-b4c4-801fb00f593b req-497f390b-8a1e-4451-a33e-2cae6520a76d service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] No waiting events found dispatching network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:22:37 user nova-compute[72184]: WARNING nova.compute.manager [req-8a49dffd-4ee6-4a58-b4c4-801fb00f593b req-497f390b-8a1e-4451-a33e-2cae6520a76d service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received unexpected event network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f for instance with vm_state building and task_state spawning.
Aug 01 17:22:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910559.3116164, aaa9f081-9366-4493-b687-1698c6ee15d6 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] VM Resumed (Lifecycle Event)
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Instance spawned successfully.
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910559.31234, aaa9f081-9366-4493-b687-1698c6ee15d6 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] VM Started (Lifecycle Event)
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:39 user nova-compute[72184]: INFO nova.compute.manager [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Took 18.35 seconds to build instance.
Aug 01 17:22:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-4f00c596-9f3e-4a86-95e4-72b59b40d379 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.455s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-656dbeb4-2955-4f80-b795-da304b2e050c req-740a5ae7-7abf-44b7-a156-4fd220109176 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-656dbeb4-2955-4f80-b795-da304b2e050c req-740a5ae7-7abf-44b7-a156-4fd220109176 service nova] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-656dbeb4-2955-4f80-b795-da304b2e050c req-740a5ae7-7abf-44b7-a156-4fd220109176 service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-656dbeb4-2955-4f80-b795-da304b2e050c req-740a5ae7-7abf-44b7-a156-4fd220109176 service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-656dbeb4-2955-4f80-b795-da304b2e050c req-740a5ae7-7abf-44b7-a156-4fd220109176 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] No waiting events found dispatching network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:22:39 user nova-compute[72184]: WARNING nova.compute.manager [req-656dbeb4-2955-4f80-b795-da304b2e050c req-740a5ae7-7abf-44b7-a156-4fd220109176 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received unexpected event network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f for instance with vm_state active and task_state None.
Aug 01 17:22:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puMsUZjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:40 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:40 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:40 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3365939b-6140-494d-9ed7-6be8040f082e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:22:40 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5598a1cf-6f86-4f77-9d2b-c2bc53ab97bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d] added
Aug 01 17:22:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5536949a-74b7-43c4-9cca-460086d82850]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd4011-b2be-4664-92ae-76757301f5a6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puMsUZjc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puMsUZjc" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e7bb2-bfbf-4593-a65a-23ea9a1a24b3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puMsUZjc'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16392ef8-b9d6-4188-9a77-9a60366e6620]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469465a-97a0-4463-9fef-9b0abe9295d0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:40 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:40 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b991cd-ea03-4154-aaf9-f9f16511c7fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260]
Aug 01 17:22:40 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260] successful.
Aug 01 17:22:40 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7d6103-6152-45ba-a59a-29ba47ddd6b7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:40 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92e2742-1265-4c69-82b7-6c65ce6aa88e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:41 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:41 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:41 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:41 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:41 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:41 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb65ced2-3f76-496c-b940-6901d52847dc]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:41 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puMsUZjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23337323037343864', 'path': '/dev/sdd'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337323037343864', 'path': '/dev/sdd'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:22:42 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:42 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:22:42 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:22:42 user nova-compute[72184]:   <serial>82c492e7-1542-44f0-abc6-9ea6f2b4fe7d</serial>
Aug 01 17:22:42 user nova-compute[72184]: </disk>
Aug 01 17:22:42 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No VIF found with MAC fa:16:3e:89:4d:24, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:22:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b75d5159-7e27-40be-8854-5a1062dddc38 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.384s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:44 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910549.5753043, c7d35dee-22ac-440b-8a9e-994831bbc55c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:22:44 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] VM Stopped (Lifecycle Event)
Aug 01 17:22:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b5b052a5-955e-47ed-97c8-39f795676e2d None None] [instance: c7d35dee-22ac-440b-8a9e-994831bbc55c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:22:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG nova.objects.instance [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:46 user nova-compute[72184]: INFO nova.compute.manager [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attaching volume 05672fd3-a43b-4842-8215-c443f8d867a0 to /dev/vdc
Aug 01 17:22:46 user nova-compute[72184]: DEBUG os_brick.utils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea886f-ce03-412e-945c-91de2452bcf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5380b0-9ae6-4ae6-8583-f920985c1b69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb5fa5-cf18-42a8-8463-49aa63a3ea43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b33bd2-b54e-4f32-8bd7-1135dd8e215f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:22:46 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:22:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fa974e-658a-46d2-ad51-36dc049d247d]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG os_brick.utils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:46 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updating existing volume attachment record: f6089139-5603-4579-a423-0d2f9acb21cd {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:22:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqolCsbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:54 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:54 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:54 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[963da9e7-ab92-4cee-87db-f7566d324e40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:22:54 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c27b84-68cf-4cd5-b620-8b9d6a5668af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0] added
Aug 01 17:22:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dffeb39-c15a-47b4-8316-1d23df44e283]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f77a65-a564-4cfa-988c-7400fc5ce2fb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqolCsbc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqolCsbc" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[553300c4-ea9d-4530-becf-b9bf0c2236f1]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gqolCsbc'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e389b-2356-4734-a879-20995fbe262c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af99576c-c97d-4bbc-9666-fae5d75978ae]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a887b2-ba98-4045-b054-e92a234a59e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260]
Aug 01 17:22:54 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260] successful.
Aug 01 17:22:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945dd6b-17e8-4143-a87a-7e611577b61c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d6662a-55f7-4d73-9020-27861242977c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:54 user nova-compute[72184]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)
Aug 01 17:22:54 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdb3dfa-b558-475d-a4ab-0b1d72b4e337]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:22:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqolCsbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23065386637313561', 'path': '/dev/sde'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065386637313561', 'path': '/dev/sde'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG nova.objects.instance [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:22:55 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:55 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 17:22:55 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:22:55 user nova-compute[72184]:   <serial>05672fd3-a43b-4842-8215-c443f8d867a0</serial>
Aug 01 17:22:55 user nova-compute[72184]: </disk>
Aug 01 17:22:55 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:22:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] No VIF found with MAC fa:16:3e:89:4d:24, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-10e9f4f4-3a9c-49af-9b04-51cd86e1b5dc tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.479s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:56 user nova-compute[72184]: INFO nova.compute.manager [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Detaching volume 82c492e7-1542-44f0-abc6-9ea6f2b4fe7d
Aug 01 17:22:56 user nova-compute[72184]: INFO nova.virt.block_device [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attempting to driver detach volume 82c492e7-1542-44f0-abc6-9ea6f2b4fe7d from mountpoint /dev/vdb
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Attempting to detach device vdb from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:22:56 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:56 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:22:56 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:22:56 user nova-compute[72184]:   <serial>82c492e7-1542-44f0-abc6-9ea6f2b4fe7d</serial>
Aug 01 17:22:56 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:22:56 user nova-compute[72184]: </disk>
Aug 01 17:22:56 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:22:56 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully detached device vdb from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the persistent domain config.
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:22:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:22:56 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:56 user nova-compute[72184]:   <source dev="/dev/sdd"/>
Aug 01 17:22:56 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:22:56 user nova-compute[72184]:   <serial>82c492e7-1542-44f0-abc6-9ea6f2b4fe7d</serial>
Aug 01 17:22:56 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:22:56 user nova-compute[72184]: </disk>
Aug 01 17:22:56 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910577.3843055, e0931984-d881-4f17-97cf-3e4895bec1e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:22:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully detached device vdb from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the live domain config.
Aug 01 17:22:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puMsUZjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:57 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9b396-6e59-4a5d-9edd-3422be78fb01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eff5d1-f890-480c-90bf-5978a1d0f116]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:57 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:57 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:57 user nova-compute[72184]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)
Aug 01 17:22:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:57 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:57 user nova-compute[72184]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d (non-flash)
Aug 01 17:22:57 user nova-compute[72184]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)
Aug 01 17:22:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f302618f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d'): ({'sdd'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Removing single pathed devices sdd {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d5833-b82b-40cf-b056-12e2e66a9a48]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[918301cb-c37a-45e8-a0e9-d4cd3da39210]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flushing IO for device /dev/sdd {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96486e87-b6fd-44d6-8dfb-c18d52f6ee0b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46c3750-0fc2-4e0f-bf41-1f522f4a8edb]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] SCSI volumes sdd have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c32337-21e3-4847-8785-806cc789c80e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94603a50-c255-40b5-ab5f-13082d7c00b1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260]
Aug 01 17:22:57 user nova-compute[72184]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d, portal: 172.16.0.220,3260] successful.
Aug 01 17:22:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c492e7-1542-44f0-abc6-9ea6f2b4fe7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5de80c-e863-4345-827a-515bc8b0b58f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== disconnect_volume: return (292ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:22:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:22:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:22:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6e510f1e-604e-4c6b-9342-31c52949b417 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:22:59 user nova-compute[72184]: INFO nova.compute.manager [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Detaching volume 05672fd3-a43b-4842-8215-c443f8d867a0
Aug 01 17:22:59 user nova-compute[72184]: INFO nova.virt.block_device [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Attempting to driver detach volume 05672fd3-a43b-4842-8215-c443f8d867a0 from mountpoint /dev/vdc
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Attempting to detach device vdc from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:22:59 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:59 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 17:22:59 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:22:59 user nova-compute[72184]:   <serial>05672fd3-a43b-4842-8215-c443f8d867a0</serial>
Aug 01 17:22:59 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 17:22:59 user nova-compute[72184]: </disk>
Aug 01 17:22:59 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:22:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully detached device vdc from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the persistent domain config.
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:22:59 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:22:59 user nova-compute[72184]:   <source dev="/dev/sde"/>
Aug 01 17:22:59 user nova-compute[72184]:   <target dev="vdc" bus="virtio"/>
Aug 01 17:22:59 user nova-compute[72184]:   <serial>05672fd3-a43b-4842-8215-c443f8d867a0</serial>
Aug 01 17:22:59 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 17:22:59 user nova-compute[72184]: </disk>
Aug 01 17:22:59 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910579.7652247, e0931984-d881-4f17-97cf-3e4895bec1e2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:22:59 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully detached device vdc from instance e0931984-d881-4f17-97cf-3e4895bec1e2 from the live domain config.
Aug 01 17:22:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqolCsbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:22:59 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0c7df6-8e78-4779-bf7c-900f6d66a533]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[de200142-c0cf-4937-a90c-da5cc84e8d80]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:59 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:59 user nova-compute[72184]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)
Aug 01 17:22:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:22:59 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:22:59 user nova-compute[72184]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 (non-flash)
Aug 01 17:22:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301815d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0'): ({'sde'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Removing single pathed devices sde {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e97c170-e9d9-49b0-a727-f57742c859b4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda6193a-40a9-4e76-8e63-ef4b865bce69]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Flushing IO for device /dev/sde {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0278f1-d343-4aac-a178-c3019ddcd373]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31780b5e-6847-4cbd-b584-ac4e76dfff42]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] SCSI volumes sde have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:22:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a968c7d-e109-4bc0-a16d-98834fc4e58d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52923e6-f9b6-401d-91c8-5a6e75dccbb4]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260]
Aug 01 17:23:00 user nova-compute[72184]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0, portal: 172.16.0.220,3260] successful.
Aug 01 17:23:00 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05672fd3-a43b-4842-8215-c443f8d867a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ba80b-1ebd-42cd-b421-2871bc83edb0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] <== disconnect_volume: return (318ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'flavor' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-28090bed-8d94-4c01-bb1b-b57926cf1276 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:02 user nova-compute[72184]: INFO nova.compute.manager [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Terminating instance
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-82dabe9c-0cb7-46ae-ad47-5138dfde3ad8 req-21c8d9ea-488a-4462-86b4-fb721c9092cc service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-unplugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-82dabe9c-0cb7-46ae-ad47-5138dfde3ad8 req-21c8d9ea-488a-4462-86b4-fb721c9092cc service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-82dabe9c-0cb7-46ae-ad47-5138dfde3ad8 req-21c8d9ea-488a-4462-86b4-fb721c9092cc service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-82dabe9c-0cb7-46ae-ad47-5138dfde3ad8 req-21c8d9ea-488a-4462-86b4-fb721c9092cc service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-82dabe9c-0cb7-46ae-ad47-5138dfde3ad8 req-21c8d9ea-488a-4462-86b4-fb721c9092cc service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-unplugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-82dabe9c-0cb7-46ae-ad47-5138dfde3ad8 req-21c8d9ea-488a-4462-86b4-fb721c9092cc service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-unplugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Instance destroyed successfully.
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lazy-loading 'resources' on Instance uuid e0931984-d881-4f17-97cf-3e4895bec1e2 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1559339955',display_name='tempest-AttachVolumeTestJSON-server-1559339955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1559339955',id=46,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6gg/w7RX9CSmA21p/bmMsF5f4DWttaGYsJ6F8J/RSYuMwbgXxivewORZwIN3QNpxh5Cv5BzCuMTdZOMXzA0wImatE/R6c+MUuoQcJRzXxIlqMt4lqg+Mpg6qbKSKr51A==',key_name='tempest-keypair-574732242',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88373a3db0cb453b99f922d0a1a31781',ramdisk_id='',reservation_id='r-ts9hs0a1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-984518084',owner_user_name='tempest-AttachVolumeTestJSON-984518084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5af08a5f7d46bdb7512360bcae3905',uuid=e0931984-d881-4f17-97cf-3e4895bec1e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converting VIF {"id": "256b2df4-273e-4422-920d-2f237f584bfd", "address": "fa:16:3e:89:4d:24", "network": {"id": "1de22f7b-f890-4d5d-914e-9dd2d829bc43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1148455617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88373a3db0cb453b99f922d0a1a31781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256b2df4-27", "ovs_interfaceid": "256b2df4-273e-4422-920d-2f237f584bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG os_vif [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap256b2df4-27, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:23:02 user nova-compute[72184]: INFO os_vif [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4d:24,bridge_name='br-int',has_traffic_filtering=True,id=256b2df4-273e-4422-920d-2f237f584bfd,network=Network(1de22f7b-f890-4d5d-914e-9dd2d829bc43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256b2df4-27')
Aug 01 17:23:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Deleting instance files /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2_del
Aug 01 17:23:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Deletion of /opt/stack/data/nova/instances/e0931984-d881-4f17-97cf-3e4895bec1e2_del complete
Aug 01 17:23:02 user nova-compute[72184]: INFO nova.compute.manager [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 17:23:02 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:23:02 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:23:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:04 user nova-compute[72184]: WARNING nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received unexpected event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with vm_state active and task_state deleting.
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:04 user nova-compute[72184]: WARNING nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received unexpected event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with vm_state active and task_state deleting.
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:04 user nova-compute[72184]: WARNING nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received unexpected event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with vm_state active and task_state deleting.
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-unplugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-unplugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG nova.compute.manager [req-3ae5628a-ff53-4b2e-b2df-f8c0cb5eef6f req-40bc34ab-0be8-425b-aadd-400f1214e670 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-unplugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:23:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:05 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:23:05 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Took 2.22 seconds to deallocate network for instance.
Aug 01 17:23:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:05 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:23:05 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:23:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:05 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Deleted allocations for instance e0931984-d881-4f17-97cf-3e4895bec1e2
Aug 01 17:23:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e854310e-9688-4ba1-bafb-5f2bd39e8390 tempest-AttachVolumeTestJSON-984518084 tempest-AttachVolumeTestJSON-984518084-project-member] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.457s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] Acquiring lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:06 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] Lock "e0931984-d881-4f17-97cf-3e4895bec1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] No waiting events found dispatching network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:06 user nova-compute[72184]: WARNING nova.compute.manager [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received unexpected event network-vif-plugged-256b2df4-273e-4422-920d-2f237f584bfd for instance with vm_state deleted and task_state None.
Aug 01 17:23:06 user nova-compute[72184]: DEBUG nova.compute.manager [req-113b018b-6e8c-4aa7-8d21-f5bb69498550 req-dac8dcca-4fad-42c2-9e8a-154181a8f809 service nova] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Received event network-vif-deleted-256b2df4-273e-4422-920d-2f237f584bfd {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:10 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:23:11 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:23:12 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:23:12 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=25.243061065673828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 45365011-819c-4787-8225-7e3abaac8d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aaa9f081-9366-4493-b687-1698c6ee15d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910582.8032694, e0931984-d881-4f17-97cf-3e4895bec1e2 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:23:17 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] VM Stopped (Lifecycle Event)
Aug 01 17:23:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-755f56d8-6cc4-49cb-831a-7b7a040bdfbf None None] [instance: e0931984-d881-4f17-97cf-3e4895bec1e2] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:23:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:23:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:23:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:23:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:33 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:23:43 user nova-compute[72184]: INFO nova.compute.claims [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Claim successful on node user
Aug 01 17:23:43 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:23:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.policy [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9915d8500a3a478f9e34b09f53f0b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8a5b2893a34d41ae1b4e5bd4bb3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:23:44 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Creating image(s)
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "/opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "/opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.127s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk 1073741824" returned: 0 in 0.047s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.126s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Cannot resize image /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'migration_context' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Successfully created port: 8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Ensure instance console log exists: /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Successfully updated port: 8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-changed-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Refreshing instance network info cache due to event network-changed-8b7f341d-87fc-4e60-82c7-a1bad8da84c2. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:23:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.neutron [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Instance network_info: |[{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Refreshing network info cache for port 8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Start _get_guest_xml network_info=[{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:23:46 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:23:46 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1900936463',display_name='tempest-SnapshotDataIntegrityTests-server-1900936463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1900936463',id=48,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ77uGw9746GGn4amUfaJX7mj3rKyK8yQa7C0nhc/KEvgf7m9k19jBYHV4QrZRoSfk2MrSBrklDIYhSv3MYBRzH9ur7+olSwB4yir7y4jfcguGwUqKDoggxYs61kLAESXg==',key_name='tempest-keypair-768099462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d8a5b2893a34d41ae1b4e5bd4bb3ef5',ramdisk_id='',reservation_id='r-c3pk10tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-899754403',owner_user_name='tempest-SnapshotDataIntegrityTests-899754403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9915d8500a3a478f9e34b09f53f0b217',uuid=3a39a8b2-dde5-4e39-b8c5-21a48acac36c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Converting VIF {"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.objects.instance [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:23:46 user nova-compute[72184]:   <uuid>3a39a8b2-dde5-4e39-b8c5-21a48acac36c</uuid>
Aug 01 17:23:46 user nova-compute[72184]:   <name>instance-00000030</name>
Aug 01 17:23:46 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:23:46 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:23:46 user nova-compute[72184]:   <metadata>
Aug 01 17:23:46 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:23:46 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:23:46 user nova-compute[72184]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1900936463</nova:name>
Aug 01 17:23:46 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:23:46</nova:creationTime>
Aug 01 17:23:46 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:23:46 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:23:46 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:23:46 user nova-compute[72184]:       <nova:owner>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:user uuid="9915d8500a3a478f9e34b09f53f0b217">tempest-SnapshotDataIntegrityTests-899754403-project-member</nova:user>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:project uuid="0d8a5b2893a34d41ae1b4e5bd4bb3ef5">tempest-SnapshotDataIntegrityTests-899754403</nova:project>
Aug 01 17:23:46 user nova-compute[72184]:       </nova:owner>
Aug 01 17:23:46 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:23:46 user nova-compute[72184]:       <nova:ports>
Aug 01 17:23:46 user nova-compute[72184]:         <nova:port uuid="8b7f341d-87fc-4e60-82c7-a1bad8da84c2">
Aug 01 17:23:46 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 17:23:46 user nova-compute[72184]:         </nova:port>
Aug 01 17:23:46 user nova-compute[72184]:       </nova:ports>
Aug 01 17:23:46 user nova-compute[72184]:     </nova:instance>
Aug 01 17:23:46 user nova-compute[72184]:   </metadata>
Aug 01 17:23:46 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:23:46 user nova-compute[72184]:     <system>
Aug 01 17:23:46 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:23:46 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:23:46 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:23:46 user nova-compute[72184]:       <entry name="serial">3a39a8b2-dde5-4e39-b8c5-21a48acac36c</entry>
Aug 01 17:23:46 user nova-compute[72184]:       <entry name="uuid">3a39a8b2-dde5-4e39-b8c5-21a48acac36c</entry>
Aug 01 17:23:46 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:23:46 user nova-compute[72184]:     </system>
Aug 01 17:23:46 user nova-compute[72184]:   </sysinfo>
Aug 01 17:23:46 user nova-compute[72184]:   <os>
Aug 01 17:23:46 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:23:46 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:23:46 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:23:46 user nova-compute[72184]:   </os>
Aug 01 17:23:46 user nova-compute[72184]:   <features>
Aug 01 17:23:46 user nova-compute[72184]:     <acpi/>
Aug 01 17:23:46 user nova-compute[72184]:     <apic/>
Aug 01 17:23:46 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:23:46 user nova-compute[72184]:   </features>
Aug 01 17:23:46 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:23:46 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:23:46 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:23:46 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:23:46 user nova-compute[72184]:   </clock>
Aug 01 17:23:46 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:23:46 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:23:46 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:23:46 user nova-compute[72184]:   </cpu>
Aug 01 17:23:46 user nova-compute[72184]:   <devices>
Aug 01 17:23:46 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:23:46 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:23:46 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk"/>
Aug 01 17:23:46 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:23:46 user nova-compute[72184]:     </disk>
Aug 01 17:23:46 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:23:46 user nova-compute[72184]:       <mac address="fa:16:3e:43:17:17"/>
Aug 01 17:23:46 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:23:46 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:23:46 user nova-compute[72184]:       <target dev="tap8b7f341d-87"/>
Aug 01 17:23:46 user nova-compute[72184]:     </interface>
Aug 01 17:23:46 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:23:46 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/console.log" append="off"/>
Aug 01 17:23:46 user nova-compute[72184]:     </serial>
Aug 01 17:23:46 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:23:46 user nova-compute[72184]:     <video>
Aug 01 17:23:46 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:23:46 user nova-compute[72184]:     </video>
Aug 01 17:23:46 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:23:46 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:23:46 user nova-compute[72184]:     </rng>
Aug 01 17:23:46 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:23:46 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:23:46 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:23:46 user nova-compute[72184]:     </memballoon>
Aug 01 17:23:46 user nova-compute[72184]:   </devices>
Aug 01 17:23:46 user nova-compute[72184]: </domain>
Aug 01 17:23:46 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1900936463',display_name='tempest-SnapshotDataIntegrityTests-server-1900936463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1900936463',id=48,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ77uGw9746GGn4amUfaJX7mj3rKyK8yQa7C0nhc/KEvgf7m9k19jBYHV4QrZRoSfk2MrSBrklDIYhSv3MYBRzH9ur7+olSwB4yir7y4jfcguGwUqKDoggxYs61kLAESXg==',key_name='tempest-keypair-768099462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d8a5b2893a34d41ae1b4e5bd4bb3ef5',ramdisk_id='',reservation_id='r-c3pk10tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-899754403',owner_user_name='tempest-SnapshotDataIntegrityTests-899754403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9915d8500a3a478f9e34b09f53f0b217',uuid=3a39a8b2-dde5-4e39-b8c5-21a48acac36c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Converting VIF {"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG os_vif [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b7f341d-87, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b7f341d-87, col_values=(('external_ids', {'iface-id': '8b7f341d-87fc-4e60-82c7-a1bad8da84c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:17:17', 'vm-uuid': '3a39a8b2-dde5-4e39-b8c5-21a48acac36c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:46 user nova-compute[72184]: INFO os_vif [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87')
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No VIF found with MAC fa:16:3e:43:17:17, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated VIF entry in instance network info cache for port 8b7f341d-87fc-4e60-82c7-a1bad8da84c2. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:23:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-09439fa2-e9c4-4c6e-95c6-744b27bbe94a req-94302834-13bb-4207-ad27-295791dcab55 service nova] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-45ac1361-2d30-4a61-b614-35f4d6784498 req-5f6c94fa-4770-4dce-a305-3f1d062c66a2 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-45ac1361-2d30-4a61-b614-35f4d6784498 req-5f6c94fa-4770-4dce-a305-3f1d062c66a2 service nova] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-45ac1361-2d30-4a61-b614-35f4d6784498 req-5f6c94fa-4770-4dce-a305-3f1d062c66a2 service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-45ac1361-2d30-4a61-b614-35f4d6784498 req-5f6c94fa-4770-4dce-a305-3f1d062c66a2 service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-45ac1361-2d30-4a61-b614-35f4d6784498 req-5f6c94fa-4770-4dce-a305-3f1d062c66a2 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] No waiting events found dispatching network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:47 user nova-compute[72184]: WARNING nova.compute.manager [req-45ac1361-2d30-4a61-b614-35f4d6784498 req-5f6c94fa-4770-4dce-a305-3f1d062c66a2 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received unexpected event network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 for instance with vm_state building and task_state spawning.
Aug 01 17:23:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910629.8678508, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:23:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] VM Resumed (Lifecycle Event)
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:23:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Instance spawned successfully.
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:23:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910629.8698332, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:23:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] VM Started (Lifecycle Event)
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:23:49 user nova-compute[72184]: INFO nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 01 17:23:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:23:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:23:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-e78ced30-c239-43d7-99e3-3b97496735cd req-d79bdf9b-268e-4a37-b02c-b47fe6144b3c service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e78ced30-c239-43d7-99e3-3b97496735cd req-d79bdf9b-268e-4a37-b02c-b47fe6144b3c service nova] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e78ced30-c239-43d7-99e3-3b97496735cd req-d79bdf9b-268e-4a37-b02c-b47fe6144b3c service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e78ced30-c239-43d7-99e3-3b97496735cd req-d79bdf9b-268e-4a37-b02c-b47fe6144b3c service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:50 user nova-compute[72184]: DEBUG nova.compute.manager [req-e78ced30-c239-43d7-99e3-3b97496735cd req-d79bdf9b-268e-4a37-b02c-b47fe6144b3c service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] No waiting events found dispatching network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:23:50 user nova-compute[72184]: WARNING nova.compute.manager [req-e78ced30-c239-43d7-99e3-3b97496735cd req-d79bdf9b-268e-4a37-b02c-b47fe6144b3c service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received unexpected event network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 for instance with vm_state building and task_state spawning.
Aug 01 17:23:50 user nova-compute[72184]: INFO nova.compute.manager [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Took 6.38 seconds to build instance.
Aug 01 17:23:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-f4be1619-9ee7-4119-bf3d-b85b15ce8a94 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.601s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:51 user nova-compute[72184]: INFO nova.compute.manager [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Unshelving
Aug 01 17:23:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'pci_requests' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'numa_topology' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:23:51 user nova-compute[72184]: INFO nova.compute.claims [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Claim successful on node user
Aug 01 17:23:51 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:23:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:51 user nova-compute[72184]: INFO nova.network.neutron [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 17:23:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:23:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:23:52 user nova-compute[72184]: DEBUG nova.network.neutron [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:23:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:23:52 user nova-compute[72184]: DEBUG nova.compute.manager [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing instance network info cache due to event network-changed-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:23:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG nova.network.neutron [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:23:53 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Creating image(s)
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG nova.objects.instance [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'trusted_certs' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG nova.network.neutron [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Refreshing network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG nova.virt.images [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] 0f882b18-2fa6-43d7-a707-fecc67ee4abd was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.part /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updated VIF entry in instance network info cache for port 8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG nova.network.neutron [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:23:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bfa65247-90a8-402f-b95c-4282ee62466c req-8cd5c346-1cc6-46f0-8757-711a27aea077 service nova] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.part /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.converted" returned: 0 in 0.607s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.171s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef,backing_fmt=raw /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef,backing_fmt=raw /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk 1073741824" returned: 0 in 0.057s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:55 user nova-compute[72184]: DEBUG nova.objects.instance [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'migration_context' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:55 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Rebasing disk image.
Aug 01 17:23:55 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:56 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 -F raw /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:23:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 -F raw /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk" returned: 0 in 2.050s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Ensure instance console log exists: /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Start _get_guest_xml network_info=[{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='191656e01dd0e76847de2fe4d0076e94',container_format='bare',created_at=2023-08-01T17:21:59Z,direct_url=<?>,disk_format='qcow2',id=0f882b18-2fa6-43d7-a707-fecc67ee4abd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2078382299-shelved',owner='77fc1bb5f955400196d88dbc81346bb5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T17:22:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:23:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:23:58 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='191656e01dd0e76847de2fe4d0076e94',container_format='bare',created_at=2023-08-01T17:21:59Z,direct_url=<?>,disk_format='qcow2',id=0f882b18-2fa6-43d7-a707-fecc67ee4abd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2078382299-shelved',owner='77fc1bb5f955400196d88dbc81346bb5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T17:22:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'vcpu_model' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078382299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078382299',id=44,image_ref='0f882b18-2fa6-43d7-a707-fecc67ee4abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1732064922',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-hbm38lhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member',shelved_at='2023-08-01T17:22:03.189044',shelved_host='user',shelved_image_id='0f882b18-2fa6-43d7-a707-fecc67ee4abd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=904e24fe-feb4-4349-a9ce-f5921745b35c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'pci_devices' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:23:58 user nova-compute[72184]:   <uuid>904e24fe-feb4-4349-a9ce-f5921745b35c</uuid>
Aug 01 17:23:58 user nova-compute[72184]:   <name>instance-0000002c</name>
Aug 01 17:23:58 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:23:58 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:23:58 user nova-compute[72184]:   <metadata>
Aug 01 17:23:58 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:23:58 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:23:58 user nova-compute[72184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2078382299</nova:name>
Aug 01 17:23:58 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:23:58</nova:creationTime>
Aug 01 17:23:58 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:23:58 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:23:58 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:23:58 user nova-compute[72184]:       <nova:owner>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:user uuid="80fcd66a964e435e9b6494c67e6a9c14">tempest-AttachVolumeShelveTestJSON-1405411677-project-member</nova:user>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:project uuid="77fc1bb5f955400196d88dbc81346bb5">tempest-AttachVolumeShelveTestJSON-1405411677</nova:project>
Aug 01 17:23:58 user nova-compute[72184]:       </nova:owner>
Aug 01 17:23:58 user nova-compute[72184]:       <nova:root type="image" uuid="0f882b18-2fa6-43d7-a707-fecc67ee4abd"/>
Aug 01 17:23:58 user nova-compute[72184]:       <nova:ports>
Aug 01 17:23:58 user nova-compute[72184]:         <nova:port uuid="8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb">
Aug 01 17:23:58 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:23:58 user nova-compute[72184]:         </nova:port>
Aug 01 17:23:58 user nova-compute[72184]:       </nova:ports>
Aug 01 17:23:58 user nova-compute[72184]:     </nova:instance>
Aug 01 17:23:58 user nova-compute[72184]:   </metadata>
Aug 01 17:23:58 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:23:58 user nova-compute[72184]:     <system>
Aug 01 17:23:58 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:23:58 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:23:58 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:23:58 user nova-compute[72184]:       <entry name="serial">904e24fe-feb4-4349-a9ce-f5921745b35c</entry>
Aug 01 17:23:58 user nova-compute[72184]:       <entry name="uuid">904e24fe-feb4-4349-a9ce-f5921745b35c</entry>
Aug 01 17:23:58 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:23:58 user nova-compute[72184]:     </system>
Aug 01 17:23:58 user nova-compute[72184]:   </sysinfo>
Aug 01 17:23:58 user nova-compute[72184]:   <os>
Aug 01 17:23:58 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:23:58 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:23:58 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:23:58 user nova-compute[72184]:   </os>
Aug 01 17:23:58 user nova-compute[72184]:   <features>
Aug 01 17:23:58 user nova-compute[72184]:     <acpi/>
Aug 01 17:23:58 user nova-compute[72184]:     <apic/>
Aug 01 17:23:58 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:23:58 user nova-compute[72184]:   </features>
Aug 01 17:23:58 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:23:58 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:23:58 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:23:58 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:23:58 user nova-compute[72184]:   </clock>
Aug 01 17:23:58 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:23:58 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:23:58 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:23:58 user nova-compute[72184]:   </cpu>
Aug 01 17:23:58 user nova-compute[72184]:   <devices>
Aug 01 17:23:58 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:23:58 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:23:58 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk"/>
Aug 01 17:23:58 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:23:58 user nova-compute[72184]:     </disk>
Aug 01 17:23:58 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:23:58 user nova-compute[72184]:       <mac address="fa:16:3e:7e:7f:87"/>
Aug 01 17:23:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:23:58 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:23:58 user nova-compute[72184]:       <target dev="tap8fbf7b7c-dc"/>
Aug 01 17:23:58 user nova-compute[72184]:     </interface>
Aug 01 17:23:58 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:23:58 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/console.log" append="off"/>
Aug 01 17:23:58 user nova-compute[72184]:     </serial>
Aug 01 17:23:58 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:23:58 user nova-compute[72184]:     <video>
Aug 01 17:23:58 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:23:58 user nova-compute[72184]:     </video>
Aug 01 17:23:58 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:23:58 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:23:58 user nova-compute[72184]:     </rng>
Aug 01 17:23:58 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:23:58 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:23:58 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:23:58 user nova-compute[72184]:     </memballoon>
Aug 01 17:23:58 user nova-compute[72184]:   </devices>
Aug 01 17:23:58 user nova-compute[72184]: </domain>
Aug 01 17:23:58 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078382299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078382299',id=44,image_ref='0f882b18-2fa6-43d7-a707-fecc67ee4abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1732064922',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-hbm38lhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member',shelved_at='2023-08-01T17:22:03.189044',shelved_host='user',shelved_image_id='0f882b18-2fa6-43d7-a707-fecc67ee4abd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=904e24fe-feb4-4349-a9ce-f5921745b35c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG os_vif [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbf7b7c-dc, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fbf7b7c-dc, col_values=(('external_ids', {'iface-id': '8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:7f:87', 'vm-uuid': '904e24fe-feb4-4349-a9ce-f5921745b35c'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:58 user nova-compute[72184]: INFO os_vif [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc')
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:23:58 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] No VIF found with MAC fa:16:3e:7e:7f:87, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:23:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:23:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5701d8a-0aad-4e47-adb8-85caa18a63ba req-a6e10d35-c0eb-49e7-9568-d62ae114783f service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5701d8a-0aad-4e47-adb8-85caa18a63ba req-a6e10d35-c0eb-49e7-9568-d62ae114783f service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5701d8a-0aad-4e47-adb8-85caa18a63ba req-a6e10d35-c0eb-49e7-9568-d62ae114783f service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-c5701d8a-0aad-4e47-adb8-85caa18a63ba req-a6e10d35-c0eb-49e7-9568-d62ae114783f service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG nova.compute.manager [req-c5701d8a-0aad-4e47-adb8-85caa18a63ba req-a6e10d35-c0eb-49e7-9568-d62ae114783f service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:24:00 user nova-compute[72184]: WARNING nova.compute.manager [req-c5701d8a-0aad-4e47-adb8-85caa18a63ba req-a6e10d35-c0eb-49e7-9568-d62ae114783f service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 17:24:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-38bc0652-f417-4adc-985a-d1fc1df7938a req-8971d028-bbd7-4f76-b0f7-f085fba4cba4 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-38bc0652-f417-4adc-985a-d1fc1df7938a req-8971d028-bbd7-4f76-b0f7-f085fba4cba4 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-38bc0652-f417-4adc-985a-d1fc1df7938a req-8971d028-bbd7-4f76-b0f7-f085fba4cba4 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-38bc0652-f417-4adc-985a-d1fc1df7938a req-8971d028-bbd7-4f76-b0f7-f085fba4cba4 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [req-38bc0652-f417-4adc-985a-d1fc1df7938a req-8971d028-bbd7-4f76-b0f7-f085fba4cba4 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:24:02 user nova-compute[72184]: WARNING nova.compute.manager [req-38bc0652-f417-4adc-985a-d1fc1df7938a req-8971d028-bbd7-4f76-b0f7-f085fba4cba4 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910642.24418, 904e24fe-feb4-4349-a9ce-f5921745b35c => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:24:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] VM Resumed (Lifecycle Event)
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:24:02 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance spawned successfully.
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:24:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910642.2465863, 904e24fe-feb4-4349-a9ce-f5921745b35c => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:24:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] VM Started (Lifecycle Event)
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:24:02 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:24:02 user nova-compute[72184]: DEBUG nova.compute.manager [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:24:02 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-676d4b8a-8541-45d2-8be1-f15871d35377 tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.426s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:03 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:10 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:12 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:24:13 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:24:13 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8342MB free_disk=25.187335968017578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 45365011-819c-4787-8225-7e3abaac8d9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aaa9f081-9366-4493-b687-1698c6ee15d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 904e24fe-feb4-4349-a9ce-f5921745b35c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:24:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-changed-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Refreshing instance network info cache due to event network-changed-da7a56df-dd6c-4a63-89b7-b55db4501d5f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] Acquiring lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] Acquired lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG nova.network.neutron [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Refreshing network info cache for port da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG nova.network.neutron [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updated VIF entry in instance network info cache for port da7a56df-dd6c-4a63-89b7-b55db4501d5f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG nova.network.neutron [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updating instance_info_cache with network_info: [{"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6c1323c4-5a36-4ed8-b19d-6bb881656a5f req-a26f3283-956a-4822-a296-42e57816b695 service nova] Releasing lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:14 user nova-compute[72184]: INFO nova.compute.manager [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Terminating instance
Aug 01 17:24:14 user nova-compute[72184]: DEBUG nova.compute.manager [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Instance destroyed successfully.
Aug 01 17:24:15 user nova-compute[72184]: DEBUG nova.objects.instance [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'resources' on Instance uuid aaa9f081-9366-4493-b687-1698c6ee15d6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-331453455',display_name='tempest-TestVolumeBootPattern-server-331453455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-331453455',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:22:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-5p3akdaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:22:39Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=aaa9f081-9366-4493-b687-1698c6ee15d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_vif [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda7a56df-dd, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:24:15 user nova-compute[72184]: INFO os_vif [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=da7a56df-dd6c-4a63-89b7-b55db4501d5f,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7a56df-dd')
Aug 01 17:24:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYuScbLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:24:15 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e908a992-01bf-45ab-bb4b-dd6f267a1db7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b39ef-477b-4304-b6b4-9236b63d8b3d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:24:15 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:24:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:24:15 user nova-compute[72184]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 (non-flash)
Aug 01 17:24:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8675c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4'): ({'sdc'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Removing single pathed devices sdc {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe47bda9-64a8-4e78-9a8e-9617aecd17a4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681ab0b-485d-4f2f-a434-31efc3c2b2ac]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flushing IO for device /dev/sdc {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa845f4-c72e-4c84-9f9a-f2ab80c82b13]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc8bf8-ca0a-4d10-bd07-bf09ef034c45]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] SCSI volumes sdc have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a421dbd0-f3fd-49c9-9a24-2bd17f76a4c9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:24:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4779f438-29b7-45e5-b547-0e4bbfce27ce]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260]
Aug 01 17:24:16 user nova-compute[72184]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4, portal: 172.16.0.220,3260] successful.
Aug 01 17:24:16 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864b8fda-c4a7-45d5-906b-90c6459cdbc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c3f8d-5716-4ee3-ab3e-b6fd8dceba6e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== disconnect_volume: return (289ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:24:16 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Deleting instance files /opt/stack/data/nova/instances/aaa9f081-9366-4493-b687-1698c6ee15d6_del
Aug 01 17:24:16 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Deletion of /opt/stack/data/nova/instances/aaa9f081-9366-4493-b687-1698c6ee15d6_del complete
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-changed-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Refreshing instance network info cache due to event network-changed-da7a56df-dd6c-4a63-89b7-b55db4501d5f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Acquiring lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Acquired lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.network.neutron [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Refreshing network info cache for port da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:24:16 user nova-compute[72184]: INFO nova.compute.manager [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:24:16 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Took 0.54 seconds to deallocate network for instance.
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.network.neutron [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updated VIF entry in instance network info cache for port da7a56df-dd6c-4a63-89b7-b55db4501d5f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.network.neutron [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Updating instance_info_cache with network_info: [{"id": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "address": "fa:16:3e:e2:3c:b5", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7a56df-dd", "ovs_interfaceid": "da7a56df-dd6c-4a63-89b7-b55db4501d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Releasing lock "refresh_cache-aaa9f081-9366-4493-b687-1698c6ee15d6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-vif-unplugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] No waiting events found dispatching network-vif-unplugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-vif-unplugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Acquiring lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:16 user nova-compute[72184]: DEBUG nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] No waiting events found dispatching network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:24:16 user nova-compute[72184]: WARNING nova.compute.manager [req-2b11a8f4-ed4b-4f27-ba49-6d22903efb87 req-be70c394-248e-4dfc-be92-759dca7b83e7 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received unexpected event network-vif-plugged-da7a56df-dd6c-4a63-89b7-b55db4501d5f for instance with vm_state active and task_state deleting.
Aug 01 17:24:17 user nova-compute[72184]: INFO nova.compute.manager [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Took 0.70 seconds to detach 1 volumes for instance.
Aug 01 17:24:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:24:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:24:17 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:24:17 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:24:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:17 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Deleted allocations for instance aaa9f081-9366-4493-b687-1698c6ee15d6
Aug 01 17:24:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-b8901a18-ea5c-4895-9ae7-7533a19a6a92 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "aaa9f081-9366-4493-b687-1698c6ee15d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.759s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-ba4b469b-d1da-4f5c-afc8-9f80f9261fbc req-ac590bd8-f068-4b52-ad85-462d46ba3426 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Received event network-vif-deleted-da7a56df-dd6c-4a63-89b7-b55db4501d5f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:24:18 user nova-compute[72184]: INFO nova.compute.manager [req-ba4b469b-d1da-4f5c-afc8-9f80f9261fbc req-ac590bd8-f068-4b52-ad85-462d46ba3426 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Neutron deleted interface da7a56df-dd6c-4a63-89b7-b55db4501d5f; detaching it from the instance and deleting it from the info cache
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.network.neutron [req-ba4b469b-d1da-4f5c-afc8-9f80f9261fbc req-ac590bd8-f068-4b52-ad85-462d46ba3426 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Instance is deleted, no further info cache update {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-ba4b469b-d1da-4f5c-afc8-9f80f9261fbc req-ac590bd8-f068-4b52-ad85-462d46ba3426 service nova] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Detach interface failed, port_id=da7a56df-dd6c-4a63-89b7-b55db4501d5f, reason: Instance aaa9f081-9366-4493-b687-1698c6ee15d6 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:24:18 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:24:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [{"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:24:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-904e24fe-feb4-4349-a9ce-f5921745b35c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:24:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:24:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:24:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:24:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:30 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910655.7022293, aaa9f081-9366-4493-b687-1698c6ee15d6 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:24:30 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] VM Stopped (Lifecycle Event)
Aug 01 17:24:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-60c9e9d8-a781-4c33-9c87-8ddabbd6d86e None None] [instance: aaa9f081-9366-4493-b687-1698c6ee15d6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:24:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:24:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:25:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:25:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:12 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-changed-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG nova.compute.manager [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Refreshing instance network info cache due to event network-changed-13d5745d-295e-477f-94b1-80a904f22123. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] Acquiring lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] Acquired lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG nova.network.neutron [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Refreshing network info cache for port 13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "45365011-819c-4787-8225-7e3abaac8d9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:13 user nova-compute[72184]: INFO nova.compute.manager [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Terminating instance
Aug 01 17:25:13 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:25:13 user nova-compute[72184]: DEBUG nova.compute.manager [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:14 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:25:14 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8454MB free_disk=25.175113677978516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:14 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Instance destroyed successfully.
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.objects.instance [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lazy-loading 'resources' on Instance uuid 45365011-819c-4787-8225-7e3abaac8d9e {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-823164968',display_name='tempest-TestVolumeBootPattern-server-823164968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-823164968',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnUtt7MsTu/hKzzX1Tzc5gYnDL4r82tHjWzrRZfvzpZxymvvPcvfHLRjls/Udf8n6fAN4glx1j6pULNcglYacCVDdRGdZmuHzIrP+cuW5P2l2lcIpmcrvSS/xe0NGxmw==',key_name='tempest-TestVolumeBootPattern-1016793294',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf5145289cf4667b9398df4a8266bb4',ramdisk_id='',reservation_id='r-9r4y13fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1490009883',owner_user_name='tempest-TestVolumeBootPattern-1490009883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:20:31Z,user_data=None,user_id='9ce144879b7e4638822f0d7174693575',uuid=45365011-819c-4787-8225-7e3abaac8d9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converting VIF {"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_vif [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13d5745d-29, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:25:14 user nova-compute[72184]: INFO os_vif [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=13d5745d-295e-477f-94b1-80a904f22123,network=Network(7af1e6ce-e678-46cb-8df7-e5fa8bb99654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d5745d-29')
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLmkNtVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:25:14 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ddae1-f89c-4810-8cd8-ca9e9c661a8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 45365011-819c-4787-8225-7e3abaac8d9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 904e24fe-feb4-4349-a9ce-f5921745b35c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adec24d3-c027-48c0-99af-81f4549008f8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:25:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 (non-flash)
Aug 01 17:25:14 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8675900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:14 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a6121a-19d1-4eef-b7b8-3971db6895d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cd3101-1952-45ca-99cf-53685967f336]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace332c-2b40-4c47-b904-11d83ed05f9d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f765307-4648-4837-b17e-0d4c211b3694]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8620046f-7af2-4deb-b54e-802059b4c5ee]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.network.neutron [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updated VIF entry in instance network info cache for port 13d5745d-295e-477f-94b1-80a904f22123. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.network.neutron [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [{"id": "13d5745d-295e-477f-94b1-80a904f22123", "address": "fa:16:3e:0f:9f:77", "network": {"id": "7af1e6ce-e678-46cb-8df7-e5fa8bb99654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1701929281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf5145289cf4667b9398df4a8266bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d5745d-29", "ovs_interfaceid": "13d5745d-295e-477f-94b1-80a904f22123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-eac6927d-2ee1-4255-be60-e332a7c7ade7 req-e0bc4b6e-809d-4fbb-8ab1-3745fa413a13 service nova] Releasing lock "refresh_cache-45365011-819c-4787-8225-7e3abaac8d9e" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11abdbfb-ca44-4493-a878-32dc978b64c9]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260]
Aug 01 17:25:15 user nova-compute[72184]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577, portal: 172.16.0.220,3260] successful.
Aug 01 17:25:15 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e46f08e-a499-4ded-b913-6561d1ffd577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8acc0f4-9a2c-41eb-afbd-965f72836b33]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] <== disconnect_volume: return (296ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:25:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Deleting instance files /opt/stack/data/nova/instances/45365011-819c-4787-8225-7e3abaac8d9e_del
Aug 01 17:25:15 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Deletion of /opt/stack/data/nova/instances/45365011-819c-4787-8225-7e3abaac8d9e_del complete
Aug 01 17:25:15 user nova-compute[72184]: INFO nova.compute.manager [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-vif-unplugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] No waiting events found dispatching network-vif-unplugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-vif-unplugged-13d5745d-295e-477f-94b1-80a904f22123 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] Acquiring lock "45365011-819c-4787-8225-7e3abaac8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] Lock "45365011-819c-4787-8225-7e3abaac8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] No waiting events found dispatching network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:15 user nova-compute[72184]: WARNING nova.compute.manager [req-be4ac20f-e965-4553-a870-16c658b3ac92 req-2794a1d6-0757-4f0c-af4a-3a50f3fb6b68 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received unexpected event network-vif-plugged-13d5745d-295e-477f-94b1-80a904f22123 for instance with vm_state active and task_state deleting.
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-a782a28e-7a36-4537-9276-c9278e6db3b6 req-1760307f-e627-48fd-a3d5-6de4ba9f7cd0 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Received event network-vif-deleted-13d5745d-295e-477f-94b1-80a904f22123 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:15 user nova-compute[72184]: INFO nova.compute.manager [req-a782a28e-7a36-4537-9276-c9278e6db3b6 req-1760307f-e627-48fd-a3d5-6de4ba9f7cd0 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Neutron deleted interface 13d5745d-295e-477f-94b1-80a904f22123; detaching it from the instance and deleting it from the info cache
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.network.neutron [req-a782a28e-7a36-4537-9276-c9278e6db3b6 req-1760307f-e627-48fd-a3d5-6de4ba9f7cd0 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:25:15 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Took 0.53 seconds to deallocate network for instance.
Aug 01 17:25:15 user nova-compute[72184]: DEBUG nova.compute.manager [req-a782a28e-7a36-4537-9276-c9278e6db3b6 req-1760307f-e627-48fd-a3d5-6de4ba9f7cd0 service nova] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Detach interface failed, port_id=13d5745d-295e-477f-94b1-80a904f22123, reason: Instance 45365011-819c-4787-8225-7e3abaac8d9e could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:25:16 user nova-compute[72184]: INFO nova.compute.manager [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 17:25:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:16 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:25:16 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:25:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:16 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Deleted allocations for instance 45365011-819c-4787-8225-7e3abaac8d9e
Aug 01 17:25:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-813ca458-d0aa-4098-98dd-855b5b6809d8 tempest-TestVolumeBootPattern-1490009883 tempest-TestVolumeBootPattern-1490009883-project-member] Lock "45365011-819c-4787-8225-7e3abaac8d9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.055s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:25:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:25:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910714.5414195, 45365011-819c-4787-8225-7e3abaac8d9e => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:25:29 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] VM Stopped (Lifecycle Event)
Aug 01 17:25:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-15af5b66-b72d-4d20-8377-80f6464b4748 None None] [instance: 45365011-819c-4787-8225-7e3abaac8d9e] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:25:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-changed-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG nova.compute.manager [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Refreshing instance network info cache due to event network-changed-8b7f341d-87fc-4e60-82c7-a1bad8da84c2. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Refreshing network info cache for port 8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:35 user nova-compute[72184]: DEBUG nova.network.neutron [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated VIF entry in instance network info cache for port 8b7f341d-87fc-4e60-82c7-a1bad8da84c2. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:25:35 user nova-compute[72184]: DEBUG nova.network.neutron [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:25:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-bcf41ddd-f07a-438e-ab19-ea711b33884b req-52d765ca-9a4d-40eb-a206-4196398545aa service nova] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:39 user nova-compute[72184]: INFO nova.compute.manager [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attaching volume 1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab to /dev/vdb
Aug 01 17:25:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5354e90-91f2-477a-8f61-8380cfa9bda8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76561ba9-c34a-461b-a04d-ce6e2db7f5dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ba732-9448-4079-a29a-c9bfd4b9c5c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bdd657-fd4a-47e5-b125-a7c048a8551e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:25:39 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:25:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8acdf7-91f4-4efc-bc83-44fed88390a7]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating existing volume attachment record: fcfbd4f7-7862-46ca-a094-6e5eb11d8756 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:41 user nova-compute[72184]: INFO nova.compute.manager [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Terminating instance
Aug 01 17:25:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-27f76d73-8832-47fe-9983-c1935d8cb904 req-4f0e4ae6-6f30-4603-87a1-701403116356 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-27f76d73-8832-47fe-9983-c1935d8cb904 req-4f0e4ae6-6f30-4603-87a1-701403116356 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-27f76d73-8832-47fe-9983-c1935d8cb904 req-4f0e4ae6-6f30-4603-87a1-701403116356 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-27f76d73-8832-47fe-9983-c1935d8cb904 req-4f0e4ae6-6f30-4603-87a1-701403116356 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-27f76d73-8832-47fe-9983-c1935d8cb904 req-4f0e4ae6-6f30-4603-87a1-701403116356 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.compute.manager [req-27f76d73-8832-47fe-9983-c1935d8cb904 req-4f0e4ae6-6f30-4603-87a1-701403116356 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Instance destroyed successfully.
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.objects.instance [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lazy-loading 'resources' on Instance uuid 904e24fe-feb4-4349-a9ce-f5921745b35c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T17:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078382299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078382299',id=44,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+P0Qb9g3aA1lqgIZiwJJznmzI6niZsbVwOJY8wqivVz8g1jeoGncxrmbZiKAcslbRKs5vKMTERUWg6cHM5zJv7SFpToZsQ5pprTjq7Tun6z10zbwFwXKG6lok/djrprw==',key_name='tempest-keypair-1732064922',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77fc1bb5f955400196d88dbc81346bb5',ramdisk_id='',reservation_id='r-hbm38lhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405411677',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405411677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fcd66a964e435e9b6494c67e6a9c14',uuid=904e24fe-feb4-4349-a9ce-f5921745b35c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converting VIF {"id": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "address": "fa:16:3e:7e:7f:87", "network": {"id": "ecc97ab5-cd49-48c6-af50-19b336fa13a6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1610955420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77fc1bb5f955400196d88dbc81346bb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbf7b7c-dc", "ovs_interfaceid": "8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG os_vif [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbf7b7c-dc, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:25:42 user nova-compute[72184]: INFO os_vif [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:7f:87,bridge_name='br-int',has_traffic_filtering=True,id=8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb,network=Network(ecc97ab5-cd49-48c6-af50-19b336fa13a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbf7b7c-dc')
Aug 01 17:25:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Deleting instance files /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c_del
Aug 01 17:25:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Deletion of /opt/stack/data/nova/instances/904e24fe-feb4-4349-a9ce-f5921745b35c_del complete
Aug 01 17:25:42 user nova-compute[72184]: INFO nova.compute.manager [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 17:25:42 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:25:42 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:25:43 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Took 1.01 seconds to deallocate network for instance.
Aug 01 17:25:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-797faac9-028d-4a4e-96e3-5c9a506ec18b req-367eb321-a1ed-4f12-8568-421da575d99b service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-deleted-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:25:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:43 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Deleted allocations for instance 904e24fe-feb4-4349-a9ce-f5921745b35c
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-0109b337-7067-4cd1-b93c-8b2fe8badf3a tempest-AttachVolumeShelveTestJSON-1405411677 tempest-AttachVolumeShelveTestJSON-1405411677-project-member] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.217s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:44 user nova-compute[72184]: WARNING nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state deleted and task_state None.
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:44 user nova-compute[72184]: WARNING nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state deleted and task_state None.
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:44 user nova-compute[72184]: WARNING nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state deleted and task_state None.
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:44 user nova-compute[72184]: WARNING nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-unplugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state deleted and task_state None.
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Acquiring lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] Lock "904e24fe-feb4-4349-a9ce-f5921745b35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:44 user nova-compute[72184]: DEBUG nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] No waiting events found dispatching network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:25:44 user nova-compute[72184]: WARNING nova.compute.manager [req-0951b925-254a-43f0-8b5f-d8845b654fdb req-752345f7-d47f-4f27-b5eb-08813afb4f47 service nova] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Received unexpected event network-vif-plugged-8fbf7b7c-dc6a-49e7-81d9-ae2bd4ce9fcb for instance with vm_state deleted and task_state None.
Aug 01 17:25:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPItHOro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:25:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:25:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:25:47 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fc9d46-1d4c-420f-b632-e3817841cdb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:25:47 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[870fbc97-5b9e-460d-8641-47a549517f4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab] added
Aug 01 17:25:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be4e725-0b29-43e0-9834-f68e5d9a58f6]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bb1e53-94e7-4a84-b4e8-05c9e9375eed]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPItHOro {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPItHOro" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[817605be-5d2b-411d-a536-a4f62a6c1a09]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPItHOro'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cef27c-7d31-4fb6-a974-3f249881ce37]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142bbfc-838b-47cb-a079-bb0cd9592304]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:25:47 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:25:47 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:25:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:25:47 user nova-compute[72184]: 
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e12f659-dc60-4246-8a1e-e5f3e9ecb322]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260]
Aug 01 17:25:47 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260] successful.
Aug 01 17:25:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828bf58-11cd-4420-a4ef-d6985e3af704]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a4136b-f143-42e7-8f7d-552e482e89a1]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab (non-flash)
Aug 01 17:25:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab (non-flash)
Aug 01 17:25:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ab1077-364f-4cf4-9bd0-1f51bbfc1cdf]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:25:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPItHOro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23236663631663237', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236663631663237', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:25:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:25:48 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:25:48 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:25:48 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:25:48 user nova-compute[72184]:   <serial>1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab</serial>
Aug 01 17:25:48 user nova-compute[72184]: </disk>
Aug 01 17:25:48 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:25:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:25:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:25:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No VIF found with MAC fa:16:3e:43:17:17, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:25:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a7b74f55-a41c-4f63-ac5a-7424fd607a68 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.851s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:25:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:57 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690910742.6298456, 904e24fe-feb4-4349-a9ce-f5921745b35c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:25:57 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] VM Stopped (Lifecycle Event)
Aug 01 17:25:57 user nova-compute[72184]: DEBUG nova.compute.manager [None req-1142282e-f807-41c6-adc2-06ae4bce3bf3 None None] [instance: 904e24fe-feb4-4349-a9ce-f5921745b35c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:25:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:25:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:26:09 user nova-compute[72184]: INFO nova.compute.manager [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Detaching volume 1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab
Aug 01 17:26:09 user nova-compute[72184]: INFO nova.virt.block_device [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attempting to driver detach volume 1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab from mountpoint /dev/vdb
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Attempting to detach device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:26:09 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:26:09 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:26:09 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:26:09 user nova-compute[72184]:   <serial>1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab</serial>
Aug 01 17:26:09 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:26:09 user nova-compute[72184]: </disk>
Aug 01 17:26:09 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:26:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config.
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:26:09 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:26:09 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:26:09 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:26:09 user nova-compute[72184]:   <serial>1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab</serial>
Aug 01 17:26:09 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:26:09 user nova-compute[72184]: </disk>
Aug 01 17:26:09 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910769.640255, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:26:09 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config.
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPItHOro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:26:09 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f608acf-e284-4268-94f0-9663ac03f994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[651c9173-269d-439f-b195-b0d5464c6227]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab (non-flash)
Aug 01 17:26:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab (non-flash)
Aug 01 17:26:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff838dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed0b13-5547-4d4e-9c46-42cbaf615a69]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[820c19fc-8eb3-4076-b663-4662cf179356]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16297dd3-aba5-4749-b368-37726f62a5ad]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5c41ef-60c5-46a2-876d-f7de5630bce7]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285bb41-064a-4952-a854-25c966c81243]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ff32d-e3c7-421f-adf3-1a151a450c59]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260]
Aug 01 17:26:09 user nova-compute[72184]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab, portal: 172.16.0.220,3260] successful.
Aug 01 17:26:09 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1692ca1a-d6d0-40cd-bfd2-18ad7cc79dab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b7723-7dd0-494f-b45a-347b4cf23eff]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== disconnect_volume: return (273ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:26:09 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:26:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:12 user nova-compute[72184]: DEBUG nova.objects.instance [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:26:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-47b65dcd-a69f-4370-bf1c-5bef22c4a30d tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.004s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:26:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:14 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:15 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:26:15 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=25.191741943359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:26:15 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:26:16 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:26:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:26:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:26:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:26:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:26:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:26:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:26:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:26:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:26:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:26:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:26:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:26:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:26:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:26:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:26:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:27:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG nova.objects.instance [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:03 user nova-compute[72184]: INFO nova.compute.manager [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attaching volume 4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 to /dev/vdb
Aug 01 17:27:03 user nova-compute[72184]: DEBUG os_brick.utils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdab99-cb74-419c-b6de-7cab4a424565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f77aa52-5527-4351-ae7d-ad7dc69c33ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dfac65-7335-4d15-bc3d-354b308d2692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cd3a40-09de-4203-b55f-6a2aeff87b21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:27:03 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:27:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ddc0dd-21bf-4ca2-a88f-f4194b3205ef]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG os_brick.utils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:27:03 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating existing volume attachment record: b4b1c381-3c4e-43bb-8f2f-fc2ced4d486c {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:27:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:27:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:13 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuSqGFHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:27:16 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:27:16 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:27:16 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f62eac7-6b35-40ff-a494-163cc676aca0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:27:16 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceda3f2-f7ce-4e7a-ad27-3e6334787cb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13] added
Aug 01 17:27:16 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d5b35-eae5-409f-96de-86a68d1b13d2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed62a8-e77b-4999-8c1f-ef7eb005be42]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OuSqGFHT {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OuSqGFHT" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f99b44d-652c-43b3-9a7e-0e4f44a66863]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OuSqGFHT'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6ccc06-ba9b-4860-a3ce-bff2982661a5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccc0ba-8035-40ae-a159-6daa070878fd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:27:16 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:27:16 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:27:16 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:27:16 user nova-compute[72184]: 
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a13316-c46c-4dd4-880f-567b7852a100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260]
Aug 01 17:27:16 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260] successful.
Aug 01 17:27:16 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[199600f5-a52e-4fc5-a9a9-076571e50e05]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f1089-03ea-4e1a-aae8-bc165e4eb1a9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 (non-flash)
Aug 01 17:27:16 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 (non-flash)
Aug 01 17:27:16 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[406639a6-d539-4ba3-9d09-01f26bf356d2]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuSqGFHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:27:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:17 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:27:17 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.189380645751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26435323737666363', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323737666363', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.objects.instance [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:27:17 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:27:17 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:27:17 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:27:17 user nova-compute[72184]:   <serial>4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13</serial>
Aug 01 17:27:17 user nova-compute[72184]: </disk>
Aug 01 17:27:17 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:27:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:27:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:27:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No VIF found with MAC fa:16:3e:43:17:17, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:27:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-da4f4cc0-4dd2-4f83-abf1-dd40874fe585 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.983s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:27:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:21 user nova-compute[72184]: INFO nova.compute.manager [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Detaching volume 4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13
Aug 01 17:27:21 user nova-compute[72184]: INFO nova.virt.block_device [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attempting to driver detach volume 4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 from mountpoint /dev/vdb
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Attempting to detach device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:27:21 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:27:21 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:27:21 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:27:21 user nova-compute[72184]:   <serial>4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13</serial>
Aug 01 17:27:21 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:27:21 user nova-compute[72184]: </disk>
Aug 01 17:27:21 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:27:21 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config.
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:27:21 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:27:21 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:27:21 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:27:21 user nova-compute[72184]:   <serial>4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13</serial>
Aug 01 17:27:21 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:27:21 user nova-compute[72184]: </disk>
Aug 01 17:27:21 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910841.6282039, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:27:21 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config.
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuSqGFHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:27:21 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a086c-0603-4125-b673-0575ab2541c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a699e-2fec-43fe-8825-520294599ee4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 (non-flash)
Aug 01 17:27:21 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 (non-flash)
Aug 01 17:27:21 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301846ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e8470-e6a2-422e-b88c-6b5c0f7cc97f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6a9495-20cf-4d07-b572-46e800d08342]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90decbf4-ea36-4685-a655-6336010a51a2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c2067-06a2-41e7-af8b-29dbeb6deb39]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2032394-20b9-4beb-9212-b71d9886aa46]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de8941b-1a65-4a7f-aa60-ff74fa257a1e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260]
Aug 01 17:27:21 user nova-compute[72184]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13, portal: 172.16.0.220,3260] successful.
Aug 01 17:27:21 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4caa8fdd-5cb1-476e-8a82-e2bcb0bb0e13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2046e140-a5a3-4cdc-9c21-29182fd6fc0b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== disconnect_volume: return (254ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:27:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:24 user nova-compute[72184]: DEBUG nova.objects.instance [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:27:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-ed8bf9d5-46a3-406c-9610-22a913474c7f tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.343s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:27:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:27:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Verify base images {{(pid=72184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Image id 445427d2-2c17-4b94-ba10-8b1151983d7e yields fingerprint 5cc2fcceabfc13bc1a1ff065c8028a4bba215080 {{(pid=72184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] image 445427d2-2c17-4b94-ba10-8b1151983d7e at (/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080): checking
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] image 445427d2-2c17-4b94-ba10-8b1151983d7e at (/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080): image is in use {{(pid=72184) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] 3a39a8b2-dde5-4e39-b8c5-21a48acac36c is a valid instance name {{(pid=72184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] 3a39a8b2-dde5-4e39-b8c5-21a48acac36c has a disk file {{(pid=72184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c is backed by 5cc2fcceabfc13bc1a1ff065c8028a4bba215080 {{(pid=72184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df
Aug 01 17:27:42 user nova-compute[72184]: WARNING nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Active base files: /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Removable base files: /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819 /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907 /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f10dc4eb4a85e4e2afe07fddc2588714cbee2819
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1af170f99a0a8e216dbd220df64945f02d79fa6e
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/01a809fb45a66775fee8d0845f3c92d15acce4dd
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fe7003574a5125ebd46068bf550c969fd003c907
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b69d34c17a9e58ca9a7eb7a6c36a178dd313f0ef
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b4677bf5b0516060ccd9b2fa610027d27c44e5c
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f790b0067124c7d28e8ee6abdeb07db57642c5df
Aug 01 17:27:42 user nova-compute[72184]: INFO nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ddd560259fd173a322406f7be6ebcdad2056796
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Verification complete {{(pid=72184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Verify swap images {{(pid=72184) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.imagecache [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Verify ephemeral images {{(pid=72184) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 01 17:27:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:52 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:27:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:27:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:27:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:27:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:27:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:28:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:28:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:28:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:28:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:08 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:13 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:15 user nova-compute[72184]: INFO nova.compute.manager [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attaching volume 584caf3a-9577-4712-ae85-c67d375c27ad to /dev/vdb
Aug 01 17:28:15 user nova-compute[72184]: DEBUG os_brick.utils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1892960-53a2-4888-99e3-af33762e2c18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdae71e-a798-4230-91fa-cd08cf2b7019]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b4e29-f58a-466b-b871-3fdcd0ab681c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1d43d7-92c1-4ee4-8a05-5b3354d91672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:28:15 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:28:15 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ddc4b9-8086-4322-a5cd-3dc18001de05]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG os_brick.utils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:28:15 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating existing volume attachment record: f1ce9733-4ef2-41ee-9998-078ec1dbb05d {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:28:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:16 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:16 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:28:17 user nova-compute[72184]: INFO nova.compute.claims [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Claim successful on node user
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:28:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.policy [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3e588961be8440891af774f67f27661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4269bdc71b2348198c13616de8d84019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:28:17 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Creating image(s)
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "/opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "/opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk 1073741824" returned: 0 in 0.056s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Successfully created port: f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Cannot resize image /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lazy-loading 'migration_context' on Instance uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Ensure instance console log exists: /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:18 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:19 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:28:19 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=25.178131103515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Successfully updated port: f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquired lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-changed-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.manager [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Refreshing instance network info cache due to event network-changed-f0cdce04-b0f2-4f51-ba8e-d34740671aa8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] Acquiring lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating instance_info_cache with network_info: [{"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Releasing lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Instance network_info: |[{"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] Acquired lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Refreshing network info cache for port f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Start _get_guest_xml network_info=[{"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:28:19 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:28:19 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7439772',id=49,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vzqwJqrzIG0vu81DaGCjXETyEUFsYqZKrtID5Lu5ME6BS4yTL01cxOiBoAib/bl3UgD741ReVO4Gk9dWCjT/AOOLE3j9ZgEUwD+HBU5oCoh9BHZ5RJI9fCNphUAEW4A==',key_name='tempest-keypair-13405596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4269bdc71b2348198c13616de8d84019',ramdisk_id='',reservation_id='r-yoy2q02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630789021',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3e588961be8440891af774f67f27661',uuid=5fc10d81-6770-4ae7-abca-a0b8d0a857a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Converting VIF {"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:28:19 user nova-compute[72184]:   <uuid>5fc10d81-6770-4ae7-abca-a0b8d0a857a6</uuid>
Aug 01 17:28:19 user nova-compute[72184]:   <name>instance-00000031</name>
Aug 01 17:28:19 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:28:19 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:28:19 user nova-compute[72184]:   <metadata>
Aug 01 17:28:19 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:28:19 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:28:19 user nova-compute[72184]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224</nova:name>
Aug 01 17:28:19 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:28:19</nova:creationTime>
Aug 01 17:28:19 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:28:19 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:28:19 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:28:19 user nova-compute[72184]:       <nova:owner>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:user uuid="a3e588961be8440891af774f67f27661">tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member</nova:user>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:project uuid="4269bdc71b2348198c13616de8d84019">tempest-TestServerVolumeAttachScenarioOldVersion-1630789021</nova:project>
Aug 01 17:28:19 user nova-compute[72184]:       </nova:owner>
Aug 01 17:28:19 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:28:19 user nova-compute[72184]:       <nova:ports>
Aug 01 17:28:19 user nova-compute[72184]:         <nova:port uuid="f0cdce04-b0f2-4f51-ba8e-d34740671aa8">
Aug 01 17:28:19 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 17:28:19 user nova-compute[72184]:         </nova:port>
Aug 01 17:28:19 user nova-compute[72184]:       </nova:ports>
Aug 01 17:28:19 user nova-compute[72184]:     </nova:instance>
Aug 01 17:28:19 user nova-compute[72184]:   </metadata>
Aug 01 17:28:19 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:28:19 user nova-compute[72184]:     <system>
Aug 01 17:28:19 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:28:19 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:28:19 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:28:19 user nova-compute[72184]:       <entry name="serial">5fc10d81-6770-4ae7-abca-a0b8d0a857a6</entry>
Aug 01 17:28:19 user nova-compute[72184]:       <entry name="uuid">5fc10d81-6770-4ae7-abca-a0b8d0a857a6</entry>
Aug 01 17:28:19 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:28:19 user nova-compute[72184]:     </system>
Aug 01 17:28:19 user nova-compute[72184]:   </sysinfo>
Aug 01 17:28:19 user nova-compute[72184]:   <os>
Aug 01 17:28:19 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:28:19 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:28:19 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:28:19 user nova-compute[72184]:   </os>
Aug 01 17:28:19 user nova-compute[72184]:   <features>
Aug 01 17:28:19 user nova-compute[72184]:     <acpi/>
Aug 01 17:28:19 user nova-compute[72184]:     <apic/>
Aug 01 17:28:19 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:28:19 user nova-compute[72184]:   </features>
Aug 01 17:28:19 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:28:19 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:28:19 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:28:19 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:28:19 user nova-compute[72184]:   </clock>
Aug 01 17:28:19 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:28:19 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:28:19 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:28:19 user nova-compute[72184]:   </cpu>
Aug 01 17:28:19 user nova-compute[72184]:   <devices>
Aug 01 17:28:19 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:28:19 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:28:19 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk"/>
Aug 01 17:28:19 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:28:19 user nova-compute[72184]:     </disk>
Aug 01 17:28:19 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:28:19 user nova-compute[72184]:       <mac address="fa:16:3e:37:51:35"/>
Aug 01 17:28:19 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:28:19 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:28:19 user nova-compute[72184]:       <target dev="tapf0cdce04-b0"/>
Aug 01 17:28:19 user nova-compute[72184]:     </interface>
Aug 01 17:28:19 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:28:19 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/console.log" append="off"/>
Aug 01 17:28:19 user nova-compute[72184]:     </serial>
Aug 01 17:28:19 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:28:19 user nova-compute[72184]:     <video>
Aug 01 17:28:19 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:28:19 user nova-compute[72184]:     </video>
Aug 01 17:28:19 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:28:19 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:28:19 user nova-compute[72184]:     </rng>
Aug 01 17:28:19 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:28:19 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:28:19 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:28:19 user nova-compute[72184]:     </memballoon>
Aug 01 17:28:19 user nova-compute[72184]:   </devices>
Aug 01 17:28:19 user nova-compute[72184]: </domain>
Aug 01 17:28:19 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7439772',id=49,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vzqwJqrzIG0vu81DaGCjXETyEUFsYqZKrtID5Lu5ME6BS4yTL01cxOiBoAib/bl3UgD741ReVO4Gk9dWCjT/AOOLE3j9ZgEUwD+HBU5oCoh9BHZ5RJI9fCNphUAEW4A==',key_name='tempest-keypair-13405596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4269bdc71b2348198c13616de8d84019',ramdisk_id='',reservation_id='r-yoy2q02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630789021',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3e588961be8440891af774f67f27661',uuid=5fc10d81-6770-4ae7-abca-a0b8d0a857a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Converting VIF {"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG os_vif [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0cdce04-b0, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0cdce04-b0, col_values=(('external_ids', {'iface-id': 'f0cdce04-b0f2-4f51-ba8e-d34740671aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:51:35', 'vm-uuid': '5fc10d81-6770-4ae7-abca-a0b8d0a857a6'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:19 user nova-compute[72184]: INFO os_vif [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0')
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] No VIF found with MAC fa:16:3e:37:51:35, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updated VIF entry in instance network info cache for port f0cdce04-b0f2-4f51-ba8e-d34740671aa8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG nova.network.neutron [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating instance_info_cache with network_info: [{"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:28:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-e1654128-ad6f-4930-8819-0762b540cd74 req-4fd18faa-4237-44e2-9ac0-5b0f620145a9 service nova] Releasing lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Skipping network cache update for instance because it is Building. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-76c22d2a-efcc-479d-8fa0-dbec95882aa3 req-1207da47-940f-4662-912e-0f156c416ab6 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-76c22d2a-efcc-479d-8fa0-dbec95882aa3 req-1207da47-940f-4662-912e-0f156c416ab6 service nova] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-76c22d2a-efcc-479d-8fa0-dbec95882aa3 req-1207da47-940f-4662-912e-0f156c416ab6 service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-76c22d2a-efcc-479d-8fa0-dbec95882aa3 req-1207da47-940f-4662-912e-0f156c416ab6 service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-76c22d2a-efcc-479d-8fa0-dbec95882aa3 req-1207da47-940f-4662-912e-0f156c416ab6 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] No waiting events found dispatching network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:28:21 user nova-compute[72184]: WARNING nova.compute.manager [req-76c22d2a-efcc-479d-8fa0-dbec95882aa3 req-1207da47-940f-4662-912e-0f156c416ab6 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received unexpected event network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 for instance with vm_state building and task_state spawning.
Aug 01 17:28:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:28:22 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:28:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWuHpESO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:28:23 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:28:23 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:28:23 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61eff70-9270-4ae8-8f27-3dabc3f3b819]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:28:23 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb2d021-99ec-46a5-8800-d597990c7449]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad] added
Aug 01 17:28:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7bdb89-6225-4290-8115-4f4962fd2641]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad92c9d-fbb6-465c-a55d-4dce2950d7d3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWuHpESO {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWuHpESO" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265e593-94dc-47a2-8872-56b91a41c08f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWuHpESO'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d679cf-c2df-47b3-a639-0e9e5110daff]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b754f2b-29ba-4b12-9f61-dd06638b6b91]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:28:23 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:28:23 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:28:23 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:28:23 user nova-compute[72184]: 
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910903.1745963, 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] VM Resumed (Lifecycle Event)
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Instance spawned successfully.
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c6a85-f9b7-4e6e-a799-9e704b4dd761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260]
Aug 01 17:28:23 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260] successful.
Aug 01 17:28:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-0c95bbfb-7aba-4acb-9885-41a36ebf533a req-f5b5ce68-9656-41f3-9bf2-00bf400d4f73 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0c95bbfb-7aba-4acb-9885-41a36ebf533a req-f5b5ce68-9656-41f3-9bf2-00bf400d4f73 service nova] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0c95bbfb-7aba-4acb-9885-41a36ebf533a req-f5b5ce68-9656-41f3-9bf2-00bf400d4f73 service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0c95bbfb-7aba-4acb-9885-41a36ebf533a req-f5b5ce68-9656-41f3-9bf2-00bf400d4f73 service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [req-0c95bbfb-7aba-4acb-9885-41a36ebf533a req-f5b5ce68-9656-41f3-9bf2-00bf400d4f73 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] No waiting events found dispatching network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:28:23 user nova-compute[72184]: WARNING nova.compute.manager [req-0c95bbfb-7aba-4acb-9885-41a36ebf533a req-f5b5ce68-9656-41f3-9bf2-00bf400d4f73 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received unexpected event network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 for instance with vm_state building and task_state spawning.
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690910903.1795845, 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] VM Started (Lifecycle Event)
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e555e0b-8bdc-4ab2-958f-2d6ed1035096]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60f345-2c8a-4e7a-a476-35563032ff7c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad (non-flash)
Aug 01 17:28:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad (non-flash)
Aug 01 17:28:23 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[469bac63-e169-4600-9711-2714797e7496]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:28:23 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWuHpESO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 01 17:28:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:28:23 user nova-compute[72184]: INFO nova.compute.manager [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Took 6.42 seconds to build instance.
Aug 01 17:28:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e25d4806-46b4-442f-8929-2b531c0648c1 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.516s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23161653537626138', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653537626138', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:28:24 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:28:24 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:28:24 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:28:24 user nova-compute[72184]:   <serial>584caf3a-9577-4712-ae85-c67d375c27ad</serial>
Aug 01 17:28:24 user nova-compute[72184]: </disk>
Aug 01 17:28:24 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No VIF found with MAC fa:16:3e:43:17:17, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a37f184c-cad1-407b-8924-8a34b0d73c0a tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.273s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:26 user nova-compute[72184]: INFO nova.compute.manager [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Detaching volume 584caf3a-9577-4712-ae85-c67d375c27ad
Aug 01 17:28:26 user nova-compute[72184]: INFO nova.virt.block_device [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attempting to driver detach volume 584caf3a-9577-4712-ae85-c67d375c27ad from mountpoint /dev/vdb
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Attempting to detach device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:28:27 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:28:27 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:28:27 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:28:27 user nova-compute[72184]:   <serial>584caf3a-9577-4712-ae85-c67d375c27ad</serial>
Aug 01 17:28:27 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:28:27 user nova-compute[72184]: </disk>
Aug 01 17:28:27 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:28:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config.
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:28:27 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:28:27 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:28:27 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:28:27 user nova-compute[72184]:   <serial>584caf3a-9577-4712-ae85-c67d375c27ad</serial>
Aug 01 17:28:27 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:28:27 user nova-compute[72184]: </disk>
Aug 01 17:28:27 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910907.5655975, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:28:27 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config.
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWuHpESO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:28:27 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd4e12-e4bc-4ef8-8c25-f26492b33c19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[585d2535-e5bc-4e7d-8fad-0616bf5cc008]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad (non-flash)
Aug 01 17:28:27 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad (non-flash)
Aug 01 17:28:27 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8429cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cda629f-469e-42d8-a3a5-6795706bf4b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1c8139-a23c-480c-8673-7b5a303efb4f]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec2f82-082d-4bb6-9d6d-68a20b3372b5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5bd45-fbc8-419d-88cb-a8d82404b383]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[718918a1-9f1e-4263-bc14-decdc5a93048]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[580b3d7e-5b2e-4d64-befc-084fc5eed144]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260]
Aug 01 17:28:27 user nova-compute[72184]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad, portal: 172.16.0.220,3260] successful.
Aug 01 17:28:27 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584caf3a-9577-4712-ae85-c67d375c27ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322af41-a4b9-4b0f-a30c-ef48ea0e7d1f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== disconnect_volume: return (276ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:28:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:28 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:28:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9a428ea0-4d96-4a91-962e-11c208c2bb20 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.756s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:28:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:28:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:28:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:28:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:28:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:29:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:29:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [{"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-3a39a8b2-dde5-4e39-b8c5-21a48acac36c" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:29:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.14862060546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:29:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:29:21 user nova-compute[72184]: INFO nova.compute.manager [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attaching volume e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 to /dev/vdb
Aug 01 17:29:21 user nova-compute[72184]: DEBUG os_brick.utils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[61771dd1-9038-42ee-8fff-40c53f3b6bab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b1b7d-dba5-43f5-bb90-063474551911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baea995-3846-42c9-8caf-8c09c903af1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae6b79-88aa-4db3-a051-5a974bc217d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:29:21 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:29:21 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2b375-1100-4352-a6f2-43a6cb31b337]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG os_brick.utils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:29:21 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating existing volume attachment record: d8621768-d128-4018-aac0-076806739655 {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:29:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUbcRjiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:29:28 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:29:28 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:29:28 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5187b8-9a3d-4579-8100-c1fd7a3190a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:29:28 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90f928-86a7-45f6-b985-1bca0653ad9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7] added
Aug 01 17:29:28 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc12bd7-7c39-4ef5-ae43-ab8ee04b6242]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b9e435-5d18-4fea-ba50-6a9439557ad0]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUbcRjiK {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUbcRjiK" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8642bd4-d3fa-4b35-8a70-8deaa4b737fb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUbcRjiK'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d48c0d-93cf-49e7-908a-5b766cda3a5d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f487fdf5-a42e-4166-bc1e-00497ff51711]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:29:28 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:29:28 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:29:28 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:29:28 user nova-compute[72184]: 
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ace132-ac99-44a6-b6d2-71ec3d1f1405]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260]
Aug 01 17:29:28 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260] successful.
Aug 01 17:29:28 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95770813-293b-4405-85ec-076bb30e1937]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db43cdd3-9a66-469e-a46c-027dc87ce196]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 (non-flash)
Aug 01 17:29:28 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 (non-flash)
Aug 01 17:29:28 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9697cff-a6ca-4dc6-bef7-379b8b0b5f85]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUbcRjiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:29:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:29:29 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26137626130323636', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:29:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137626130323636', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:29:29 user nova-compute[72184]: DEBUG nova.objects.instance [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:29:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:29:29 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:29:29 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:29:29 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:29:29 user nova-compute[72184]:   <serial>e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7</serial>
Aug 01 17:29:29 user nova-compute[72184]: </disk>
Aug 01 17:29:29 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:29:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:29:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:29:30 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] No VIF found with MAC fa:16:3e:43:17:17, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:29:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-a0be02d9-ebfe-4f54-9999-82180eb0ef6c tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.010s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:29:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:29:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:29:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:29:32 user nova-compute[72184]: INFO nova.compute.manager [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Detaching volume e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7
Aug 01 17:29:32 user nova-compute[72184]: INFO nova.virt.block_device [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Attempting to driver detach volume e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 from mountpoint /dev/vdb
Aug 01 17:29:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Attempting to detach device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:29:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:29:32 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:29:32 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:29:32 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:29:32 user nova-compute[72184]:   <serial>e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7</serial>
Aug 01 17:29:32 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:29:32 user nova-compute[72184]: </disk>
Aug 01 17:29:32 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:29:32 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the persistent domain config.
Aug 01 17:29:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:29:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:29:32 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:29:32 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:29:32 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:29:32 user nova-compute[72184]:   <serial>e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7</serial>
Aug 01 17:29:32 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:29:32 user nova-compute[72184]: </disk>
Aug 01 17:29:32 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690910973.016923, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:29:33 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully detached device vdb from instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c from the live domain config.
Aug 01 17:29:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUbcRjiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:29:33 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914b5b4-9497-4f42-a0dc-eca0d7428e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff8e03-4a3a-4e84-84aa-bcf23822b856]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 (non-flash)
Aug 01 17:29:33 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 (non-flash)
Aug 01 17:29:33 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff838c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1809258c-ac6e-44cf-b283-bf0dce6c5556]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca778cc-bfcc-4b66-8423-b6b57f815438]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed9bda-e91b-483f-b259-0cc4df058e0b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b574372-8e09-4fdd-b959-5f30888a70e4]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84094f4-3c38-435f-91a1-ad5d31046163]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd86e66-93e6-437e-950d-98bb958f1078]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260]
Aug 01 17:29:33 user nova-compute[72184]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7, portal: 172.16.0.220,3260] successful.
Aug 01 17:29:33 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5d571-071b-4dcd-8e3f-4c1fb5a370e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2e3ef7-5b3e-40ba-8d5f-eb98557cc6c3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] <== disconnect_volume: return (289ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:29:33 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'flavor' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7d5360cd-404f-49a3-a0ca-24db913d13b4 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:29:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:29:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:29:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:29:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:29:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-changed-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:30:07 user nova-compute[72184]: DEBUG nova.compute.manager [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Refreshing instance network info cache due to event network-changed-f0cdce04-b0f2-4f51-ba8e-d34740671aa8. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:30:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] Acquiring lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:30:07 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] Acquired lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:30:07 user nova-compute[72184]: DEBUG nova.network.neutron [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Refreshing network info cache for port f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:30:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updated VIF entry in instance network info cache for port f0cdce04-b0f2-4f51-ba8e-d34740671aa8. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:30:08 user nova-compute[72184]: DEBUG nova.network.neutron [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating instance_info_cache with network_info: [{"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:30:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-4b4713cd-3b23-4877-a6b0-d2982c9b1b3c req-adf9b95b-ce6b-4915-8444-da0b65adb5cb service nova] Releasing lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:11 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lazy-loading 'flavor' on Instance uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:30:11 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:12 user nova-compute[72184]: INFO nova.compute.manager [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Attaching volume 1c6bfc10-2e40-4e10-8f2c-991bae56a7de to /dev/vdb
Aug 01 17:30:12 user nova-compute[72184]: DEBUG os_brick.utils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f74699-25c2-4846-8ebd-dc3de66407a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1917e281-99f5-4686-b89f-1bbf48f34442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab691c2-dcbe-40f4-8b7a-de5caf1751cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa11c83d-b524-4db3-b5ec-3b60a10a7865]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:30:12 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:30:12 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5186aa-e32f-4845-9549-58b7a2670c47]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG os_brick.utils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:30:12 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating existing volume attachment record: f13348ef-74b3-47a1-ad9a-3c2e3dc6768c {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:30:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:16 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYRTuePm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:30:20 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:30:20 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:30:20 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:30:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:30:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.147380828857422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4211ea34-ccdd-46e2-b45b-1e1e06c600c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:30:20 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d98eb1-7b8a-47f3-880f-b15b4d4957b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de] added
Aug 01 17:30:20 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f616b5-3913-4f95-909a-ac3c58d93ec9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2246c146-2ee8-458c-bd6e-86cddff17fb3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYRTuePm {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYRTuePm" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff5443-5b35-47ff-8e09-7eadb5a87a09]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYRTuePm'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1dda4c-d725-4005-bb59-e1fc5d26099c]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15577cdd-84b4-4442-9eae-888f4f76edec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:30:20 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:30:20 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:30:20 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:30:20 user nova-compute[72184]: 
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39d8912-2bab-491d-ba0d-bdfef802db64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260]
Aug 01 17:30:20 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260] successful.
Aug 01 17:30:20 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c045f940-2430-4715-8d90-37952513eaed]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a49ff-54e4-4d21-89f3-226065ab9206]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de (non-flash)
Aug 01 17:30:20 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de (non-flash)
Aug 01 17:30:20 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8569474e-6bb1-43b4-a20f-a8606bcf27d6]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:20 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYRTuePm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26261313031373263', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261313031373263', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.objects.instance [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lazy-loading 'flavor' on Instance uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:30:21 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:30:21 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:30:21 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:30:21 user nova-compute[72184]:   <serial>1c6bfc10-2e40-4e10-8f2c-991bae56a7de</serial>
Aug 01 17:30:21 user nova-compute[72184]: </disk>
Aug 01 17:30:21 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] No VIF found with MAC fa:16:3e:37:51:35, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:30:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-37dcee72-472c-45eb-8f33-4ecf6bfb076f tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.886s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:22 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating instance_info_cache with network_info: [{"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:30:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-5fc10d81-6770-4ae7-abca-a0b8d0a857a6" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:30:22 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:30:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:23 user nova-compute[72184]: INFO nova.compute.manager [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Detaching volume 1c6bfc10-2e40-4e10-8f2c-991bae56a7de
Aug 01 17:30:23 user nova-compute[72184]: INFO nova.virt.block_device [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Attempting to driver detach volume 1c6bfc10-2e40-4e10-8f2c-991bae56a7de from mountpoint /dev/vdb
Aug 01 17:30:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Attempting to detach device vdb from instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:30:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:30:23 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:30:23 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:30:23 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:30:23 user nova-compute[72184]:   <serial>1c6bfc10-2e40-4e10-8f2c-991bae56a7de</serial>
Aug 01 17:30:23 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:30:23 user nova-compute[72184]: </disk>
Aug 01 17:30:23 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:30:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Successfully detached device vdb from instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 from the persistent domain config.
Aug 01 17:30:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:30:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:30:23 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:30:23 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:30:23 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:30:23 user nova-compute[72184]:   <serial>1c6bfc10-2e40-4e10-8f2c-991bae56a7de</serial>
Aug 01 17:30:23 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:30:23 user nova-compute[72184]: </disk>
Aug 01 17:30:23 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:30:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690911024.0056276, 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:30:24 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Successfully detached device vdb from instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 from the live domain config.
Aug 01 17:30:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYRTuePm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:30:24 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f61a61-bf8e-4dfe-8cd0-5675cf69b792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e69a9cc-2acd-409a-a219-23e44e32442a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de (non-flash)
Aug 01 17:30:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de (non-flash)
Aug 01 17:30:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8677d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11feb2d7-d009-4c82-8d13-e2bbe0a02c52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eddf60-cbb5-4c77-9113-6cfd4cf293bb]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94151e7-4bf4-414c-9e7e-67cf32d06037]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa9ecb0-fd1e-460b-8c9f-dc46ede7a9a4]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4c576d-0c86-4f55-b22b-aa542ced0c1b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4193d919-ab15-4eb7-ad2e-bd62763a2510]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260]
Aug 01 17:30:24 user nova-compute[72184]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de, portal: 172.16.0.220,3260] successful.
Aug 01 17:30:24 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6bfc10-2e40-4e10-8f2c-991bae56a7de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b38a10-4e9d-4337-bcba-a9baa8c9828d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] <== disconnect_volume: return (245ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:24 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lazy-loading 'flavor' on Instance uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:30:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6eb3329a-789a-4ce9-ad77-0417511918d6 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.559s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:30:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:30:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:30:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:30:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:51 user nova-compute[72184]: INFO nova.compute.manager [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Terminating instance
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.compute.manager [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-7904c4cf-75a6-4098-9f2b-18b888ee9620 req-c8ba64d9-da5c-4217-a299-f7fb7b39d3b1 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-vif-unplugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7904c4cf-75a6-4098-9f2b-18b888ee9620 req-c8ba64d9-da5c-4217-a299-f7fb7b39d3b1 service nova] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7904c4cf-75a6-4098-9f2b-18b888ee9620 req-c8ba64d9-da5c-4217-a299-f7fb7b39d3b1 service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7904c4cf-75a6-4098-9f2b-18b888ee9620 req-c8ba64d9-da5c-4217-a299-f7fb7b39d3b1 service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-7904c4cf-75a6-4098-9f2b-18b888ee9620 req-c8ba64d9-da5c-4217-a299-f7fb7b39d3b1 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] No waiting events found dispatching network-vif-unplugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.compute.manager [req-7904c4cf-75a6-4098-9f2b-18b888ee9620 req-c8ba64d9-da5c-4217-a299-f7fb7b39d3b1 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-vif-unplugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:30:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Instance destroyed successfully.
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lazy-loading 'resources' on Instance uuid 3a39a8b2-dde5-4e39-b8c5-21a48acac36c {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1900936463',display_name='tempest-SnapshotDataIntegrityTests-server-1900936463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1900936463',id=48,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ77uGw9746GGn4amUfaJX7mj3rKyK8yQa7C0nhc/KEvgf7m9k19jBYHV4QrZRoSfk2MrSBrklDIYhSv3MYBRzH9ur7+olSwB4yir7y4jfcguGwUqKDoggxYs61kLAESXg==',key_name='tempest-keypair-768099462',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d8a5b2893a34d41ae1b4e5bd4bb3ef5',ramdisk_id='',reservation_id='r-c3pk10tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-899754403',owner_user_name='tempest-SnapshotDataIntegrityTests-899754403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9915d8500a3a478f9e34b09f53f0b217',uuid=3a39a8b2-dde5-4e39-b8c5-21a48acac36c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Converting VIF {"id": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "address": "fa:16:3e:43:17:17", "network": {"id": "dc14d0e1-f5ed-4f0c-8390-c653c655c7c2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206758562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d8a5b2893a34d41ae1b4e5bd4bb3ef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7f341d-87", "ovs_interfaceid": "8b7f341d-87fc-4e60-82c7-a1bad8da84c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG os_vif [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b7f341d-87, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:30:51 user nova-compute[72184]: INFO os_vif [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:17:17,bridge_name='br-int',has_traffic_filtering=True,id=8b7f341d-87fc-4e60-82c7-a1bad8da84c2,network=Network(dc14d0e1-f5ed-4f0c-8390-c653c655c7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7f341d-87')
Aug 01 17:30:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Deleting instance files /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c_del
Aug 01 17:30:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Deletion of /opt/stack/data/nova/instances/3a39a8b2-dde5-4e39-b8c5-21a48acac36c_del complete
Aug 01 17:30:52 user nova-compute[72184]: INFO nova.compute.manager [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 17:30:52 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:30:52 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:30:52 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:30:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:30:53 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Took 1.01 seconds to deallocate network for instance.
Aug 01 17:30:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-c8fc7a76-cb24-4b56-9edb-2dcbec7b33f2 req-a9e0cef7-6c3e-4d50-8224-b7b22ad6fe29 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-vif-deleted-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:53 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Deleted allocations for instance 3a39a8b2-dde5-4e39-b8c5-21a48acac36c
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-2aa7c9e4-ab8d-41cf-a5c7-b366c653bd58 tempest-SnapshotDataIntegrityTests-899754403 tempest-SnapshotDataIntegrityTests-899754403-project-member] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-a6f18b2f-8506-4084-aab7-bf23eb835f40 req-e56caf27-4944-424f-a8ad-b9fa3d1ac6d0 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received event network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a6f18b2f-8506-4084-aab7-bf23eb835f40 req-e56caf27-4944-424f-a8ad-b9fa3d1ac6d0 service nova] Acquiring lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a6f18b2f-8506-4084-aab7-bf23eb835f40 req-e56caf27-4944-424f-a8ad-b9fa3d1ac6d0 service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a6f18b2f-8506-4084-aab7-bf23eb835f40 req-e56caf27-4944-424f-a8ad-b9fa3d1ac6d0 service nova] Lock "3a39a8b2-dde5-4e39-b8c5-21a48acac36c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:30:53 user nova-compute[72184]: DEBUG nova.compute.manager [req-a6f18b2f-8506-4084-aab7-bf23eb835f40 req-e56caf27-4944-424f-a8ad-b9fa3d1ac6d0 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] No waiting events found dispatching network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:30:53 user nova-compute[72184]: WARNING nova.compute.manager [req-a6f18b2f-8506-4084-aab7-bf23eb835f40 req-e56caf27-4944-424f-a8ad-b9fa3d1ac6d0 service nova] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Received unexpected event network-vif-plugged-8b7f341d-87fc-4e60-82c7-a1bad8da84c2 for instance with vm_state deleted and task_state None.
Aug 01 17:30:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690911051.9048347, 3a39a8b2-dde5-4e39-b8c5-21a48acac36c => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:31:06 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] VM Stopped (Lifecycle Event)
Aug 01 17:31:06 user nova-compute[72184]: DEBUG nova.compute.manager [None req-931bae6d-f21a-4707-b548-56a0743a500d None None] [instance: 3a39a8b2-dde5-4e39-b8c5-21a48acac36c] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:31:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:31:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:31:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:31:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:18 user nova-compute[72184]: INFO nova.compute.manager [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Terminating instance
Aug 01 17:31:18 user nova-compute[72184]: DEBUG nova.compute.manager [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-87febde9-be97-4540-ab55-5252ecba4a67 req-1f91d57d-119b-40ed-9072-f76d5321376a service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-vif-unplugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-87febde9-be97-4540-ab55-5252ecba4a67 req-1f91d57d-119b-40ed-9072-f76d5321376a service nova] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-87febde9-be97-4540-ab55-5252ecba4a67 req-1f91d57d-119b-40ed-9072-f76d5321376a service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-87febde9-be97-4540-ab55-5252ecba4a67 req-1f91d57d-119b-40ed-9072-f76d5321376a service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-87febde9-be97-4540-ab55-5252ecba4a67 req-1f91d57d-119b-40ed-9072-f76d5321376a service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] No waiting events found dispatching network-vif-unplugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:31:18 user nova-compute[72184]: DEBUG nova.compute.manager [req-87febde9-be97-4540-ab55-5252ecba4a67 req-1f91d57d-119b-40ed-9072-f76d5321376a service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-vif-unplugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:31:18 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Instance destroyed successfully.
Aug 01 17:31:18 user nova-compute[72184]: DEBUG nova.objects.instance [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lazy-loading 'resources' on Instance uuid 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-743977224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7439772',id=49,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vzqwJqrzIG0vu81DaGCjXETyEUFsYqZKrtID5Lu5ME6BS4yTL01cxOiBoAib/bl3UgD741ReVO4Gk9dWCjT/AOOLE3j9ZgEUwD+HBU5oCoh9BHZ5RJI9fCNphUAEW4A==',key_name='tempest-keypair-13405596',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:28:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4269bdc71b2348198c13616de8d84019',ramdisk_id='',reservation_id='r-yoy2q02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630789021',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3e588961be8440891af774f67f27661',uuid=5fc10d81-6770-4ae7-abca-a0b8d0a857a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Converting VIF {"id": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "address": "fa:16:3e:37:51:35", "network": {"id": "e3d89b1e-71fa-4021-9696-f77eee4230fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1965482220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4269bdc71b2348198c13616de8d84019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cdce04-b0", "ovs_interfaceid": "f0cdce04-b0f2-4f51-ba8e-d34740671aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG os_vif [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0cdce04-b0, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:19 user nova-compute[72184]: INFO os_vif [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:35,bridge_name='br-int',has_traffic_filtering=True,id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8,network=Network(e3d89b1e-71fa-4021-9696-f77eee4230fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cdce04-b0')
Aug 01 17:31:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Deleting instance files /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6_del
Aug 01 17:31:19 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Deletion of /opt/stack/data/nova/instances/5fc10d81-6770-4ae7-abca-a0b8d0a857a6_del complete
Aug 01 17:31:19 user nova-compute[72184]: INFO nova.compute.manager [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 17:31:19 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:31:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-529e0902-0da7-4b2b-b557-340ba8f040ef req-3e7fb064-c175-4e66-b1aa-16fa568f7fd2 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-vif-deleted-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:31:20 user nova-compute[72184]: INFO nova.compute.manager [req-529e0902-0da7-4b2b-b557-340ba8f040ef req-3e7fb064-c175-4e66-b1aa-16fa568f7fd2 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Neutron deleted interface f0cdce04-b0f2-4f51-ba8e-d34740671aa8; detaching it from the instance and deleting it from the info cache
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.network.neutron [req-529e0902-0da7-4b2b-b557-340ba8f040ef req-3e7fb064-c175-4e66-b1aa-16fa568f7fd2 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:31:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:31:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.201862335205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.manager [req-529e0902-0da7-4b2b-b557-340ba8f040ef req-3e7fb064-c175-4e66-b1aa-16fa568f7fd2 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Detach interface failed, port_id=f0cdce04-b0f2-4f51-ba8e-d34740671aa8, reason: Instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:31:20 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Took 1.42 seconds to deallocate network for instance.
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.138s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:20 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Deleted allocations for instance 5fc10d81-6770-4ae7-abca-a0b8d0a857a6
Aug 01 17:31:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-214c9777-0d02-4fac-9845-d632584a3d09 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021 tempest-TestServerVolumeAttachScenarioOldVersion-1630789021-project-member] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.707s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-139be1ab-b638-4901-b1ca-15eef3ca3d1a req-87aa9813-2d2e-4262-bea9-2c8464a768d1 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received event network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-139be1ab-b638-4901-b1ca-15eef3ca3d1a req-87aa9813-2d2e-4262-bea9-2c8464a768d1 service nova] Acquiring lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-139be1ab-b638-4901-b1ca-15eef3ca3d1a req-87aa9813-2d2e-4262-bea9-2c8464a768d1 service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-139be1ab-b638-4901-b1ca-15eef3ca3d1a req-87aa9813-2d2e-4262-bea9-2c8464a768d1 service nova] Lock "5fc10d81-6770-4ae7-abca-a0b8d0a857a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG nova.compute.manager [req-139be1ab-b638-4901-b1ca-15eef3ca3d1a req-87aa9813-2d2e-4262-bea9-2c8464a768d1 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] No waiting events found dispatching network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:31:21 user nova-compute[72184]: WARNING nova.compute.manager [req-139be1ab-b638-4901-b1ca-15eef3ca3d1a req-87aa9813-2d2e-4262-bea9-2c8464a768d1 service nova] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Received unexpected event network-vif-plugged-f0cdce04-b0f2-4f51-ba8e-d34740671aa8 for instance with vm_state deleted and task_state None.
Aug 01 17:31:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:31:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:31:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:33 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690911078.9731445, 5fc10d81-6770-4ae7-abca-a0b8d0a857a6 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:31:33 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] VM Stopped (Lifecycle Event)
Aug 01 17:31:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-4ca7bd5f-9f6b-427b-8e9b-1f63a713272d None None] [instance: 5fc10d81-6770-4ae7-abca-a0b8d0a857a6] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:31:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:48 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:49 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:31:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:31:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:32:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:18 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:19 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:19 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:32:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:32:20 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=25.199703216552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:32:20 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:24 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:32:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:32:34 user nova-compute[72184]: INFO nova.compute.claims [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Claim successful on node user
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.network.neutron [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:32:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:32:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:32:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.policy [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0741810d24e4d5a9ee088075d9b7696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deafde8a71cd4d2b8d67c024340dcb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:32:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Creating image(s)
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "/opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "/opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "/opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.130s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.155s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk 1073741824" returned: 0 in 0.048s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Cannot resize image /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'migration_context' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Ensure instance console log exists: /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Successfully created port: 1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Successfully updated port: 1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-changed-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.compute.manager [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Refreshing instance network info cache due to event network-changed-1059bbd8-99e0-4017-822e-180957522d7e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Instance network_info: |[{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.neutron [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Refreshing network info cache for port 1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Start _get_guest_xml network_info=[{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:32:36 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:32:36 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1220250029',display_name='tempest-TestStampPattern-server-1220250029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1220250029',id=50,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWc3KYDksRWsz48abgoVGeVdd8Hqlm3MoxzJEjhVD2D/Hx7WdRAoTyYk+0isKOGHdGpM9Ne9NInMyNnXYIo2sIfH/6byQBxLMJ7nlt/0rG06VW9rST3AG44pnO4LXJajQ==',key_name='tempest-TestStampPattern-2050421810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deafde8a71cd4d2b8d67c024340dcb54',ramdisk_id='',reservation_id='r-huiwskkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-549477285',owner_user_name='tempest-TestStampPattern-549477285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:32:35Z,user_data=None,user_id='e0741810d24e4d5a9ee088075d9b7696',uuid=aecc6cfa-f081-4536-9d17-aed3be7300e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converting VIF {"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'pci_devices' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:32:36 user nova-compute[72184]:   <uuid>aecc6cfa-f081-4536-9d17-aed3be7300e9</uuid>
Aug 01 17:32:36 user nova-compute[72184]:   <name>instance-00000032</name>
Aug 01 17:32:36 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:32:36 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:32:36 user nova-compute[72184]:   <metadata>
Aug 01 17:32:36 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:32:36 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:32:36 user nova-compute[72184]:       <nova:name>tempest-TestStampPattern-server-1220250029</nova:name>
Aug 01 17:32:36 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:32:36</nova:creationTime>
Aug 01 17:32:36 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:32:36 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:32:36 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:32:36 user nova-compute[72184]:       <nova:owner>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:user uuid="e0741810d24e4d5a9ee088075d9b7696">tempest-TestStampPattern-549477285-project-member</nova:user>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:project uuid="deafde8a71cd4d2b8d67c024340dcb54">tempest-TestStampPattern-549477285</nova:project>
Aug 01 17:32:36 user nova-compute[72184]:       </nova:owner>
Aug 01 17:32:36 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:32:36 user nova-compute[72184]:       <nova:ports>
Aug 01 17:32:36 user nova-compute[72184]:         <nova:port uuid="1059bbd8-99e0-4017-822e-180957522d7e">
Aug 01 17:32:36 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 17:32:36 user nova-compute[72184]:         </nova:port>
Aug 01 17:32:36 user nova-compute[72184]:       </nova:ports>
Aug 01 17:32:36 user nova-compute[72184]:     </nova:instance>
Aug 01 17:32:36 user nova-compute[72184]:   </metadata>
Aug 01 17:32:36 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:32:36 user nova-compute[72184]:     <system>
Aug 01 17:32:36 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:32:36 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:32:36 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:32:36 user nova-compute[72184]:       <entry name="serial">aecc6cfa-f081-4536-9d17-aed3be7300e9</entry>
Aug 01 17:32:36 user nova-compute[72184]:       <entry name="uuid">aecc6cfa-f081-4536-9d17-aed3be7300e9</entry>
Aug 01 17:32:36 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:32:36 user nova-compute[72184]:     </system>
Aug 01 17:32:36 user nova-compute[72184]:   </sysinfo>
Aug 01 17:32:36 user nova-compute[72184]:   <os>
Aug 01 17:32:36 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:32:36 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:32:36 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:32:36 user nova-compute[72184]:   </os>
Aug 01 17:32:36 user nova-compute[72184]:   <features>
Aug 01 17:32:36 user nova-compute[72184]:     <acpi/>
Aug 01 17:32:36 user nova-compute[72184]:     <apic/>
Aug 01 17:32:36 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:32:36 user nova-compute[72184]:   </features>
Aug 01 17:32:36 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:32:36 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:32:36 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:32:36 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:32:36 user nova-compute[72184]:   </clock>
Aug 01 17:32:36 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:32:36 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:32:36 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:32:36 user nova-compute[72184]:   </cpu>
Aug 01 17:32:36 user nova-compute[72184]:   <devices>
Aug 01 17:32:36 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:32:36 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:32:36 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk"/>
Aug 01 17:32:36 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:32:36 user nova-compute[72184]:     </disk>
Aug 01 17:32:36 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:32:36 user nova-compute[72184]:       <mac address="fa:16:3e:3d:6e:4d"/>
Aug 01 17:32:36 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:32:36 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:32:36 user nova-compute[72184]:       <target dev="tap1059bbd8-99"/>
Aug 01 17:32:36 user nova-compute[72184]:     </interface>
Aug 01 17:32:36 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:32:36 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/console.log" append="off"/>
Aug 01 17:32:36 user nova-compute[72184]:     </serial>
Aug 01 17:32:36 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:32:36 user nova-compute[72184]:     <video>
Aug 01 17:32:36 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:32:36 user nova-compute[72184]:     </video>
Aug 01 17:32:36 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:32:36 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:32:36 user nova-compute[72184]:     </rng>
Aug 01 17:32:36 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:32:36 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:32:36 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:32:36 user nova-compute[72184]:     </memballoon>
Aug 01 17:32:36 user nova-compute[72184]:   </devices>
Aug 01 17:32:36 user nova-compute[72184]: </domain>
Aug 01 17:32:36 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1220250029',display_name='tempest-TestStampPattern-server-1220250029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1220250029',id=50,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWc3KYDksRWsz48abgoVGeVdd8Hqlm3MoxzJEjhVD2D/Hx7WdRAoTyYk+0isKOGHdGpM9Ne9NInMyNnXYIo2sIfH/6byQBxLMJ7nlt/0rG06VW9rST3AG44pnO4LXJajQ==',key_name='tempest-TestStampPattern-2050421810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deafde8a71cd4d2b8d67c024340dcb54',ramdisk_id='',reservation_id='r-huiwskkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-549477285',owner_user_name='tempest-TestStampPattern-549477285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:32:35Z,user_data=None,user_id='e0741810d24e4d5a9ee088075d9b7696',uuid=aecc6cfa-f081-4536-9d17-aed3be7300e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converting VIF {"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG os_vif [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1059bbd8-99, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1059bbd8-99, col_values=(('external_ids', {'iface-id': '1059bbd8-99e0-4017-822e-180957522d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:6e:4d', 'vm-uuid': 'aecc6cfa-f081-4536-9d17-aed3be7300e9'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:32:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:36 user nova-compute[72184]: INFO os_vif [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99')
Aug 01 17:32:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:32:37 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No VIF found with MAC fa:16:3e:3d:6e:4d, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:32:37 user nova-compute[72184]: DEBUG nova.network.neutron [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated VIF entry in instance network info cache for port 1059bbd8-99e0-4017-822e-180957522d7e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:32:37 user nova-compute[72184]: DEBUG nova.network.neutron [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:32:37 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-828df784-83ad-4b6f-9014-66a0d023aefc req-89f40203-e9b7-4144-8576-960a030ec66f service nova] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-6606a873-9b36-47d7-9842-a4ea10f39df6 req-3e3ddc5a-e533-40ae-816c-9a83df1f6525 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6606a873-9b36-47d7-9842-a4ea10f39df6 req-3e3ddc5a-e533-40ae-816c-9a83df1f6525 service nova] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6606a873-9b36-47d7-9842-a4ea10f39df6 req-3e3ddc5a-e533-40ae-816c-9a83df1f6525 service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-6606a873-9b36-47d7-9842-a4ea10f39df6 req-3e3ddc5a-e533-40ae-816c-9a83df1f6525 service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG nova.compute.manager [req-6606a873-9b36-47d7-9842-a4ea10f39df6 req-3e3ddc5a-e533-40ae-816c-9a83df1f6525 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] No waiting events found dispatching network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:32:38 user nova-compute[72184]: WARNING nova.compute.manager [req-6606a873-9b36-47d7-9842-a4ea10f39df6 req-3e3ddc5a-e533-40ae-816c-9a83df1f6525 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received unexpected event network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e for instance with vm_state building and task_state spawning.
Aug 01 17:32:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:38 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690911160.3070362, aecc6cfa-f081-4536-9d17-aed3be7300e9 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] VM Resumed (Lifecycle Event)
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Instance spawned successfully.
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690911160.3105273, aecc6cfa-f081-4536-9d17-aed3be7300e9 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] VM Started (Lifecycle Event)
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-687ae329-7988-458c-bb09-f746093f5184 req-8a966c6e-cc02-4a0a-b41e-493b76a3086b service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-687ae329-7988-458c-bb09-f746093f5184 req-8a966c6e-cc02-4a0a-b41e-493b76a3086b service nova] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-687ae329-7988-458c-bb09-f746093f5184 req-8a966c6e-cc02-4a0a-b41e-493b76a3086b service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-687ae329-7988-458c-bb09-f746093f5184 req-8a966c6e-cc02-4a0a-b41e-493b76a3086b service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-687ae329-7988-458c-bb09-f746093f5184 req-8a966c6e-cc02-4a0a-b41e-493b76a3086b service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] No waiting events found dispatching network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:32:40 user nova-compute[72184]: WARNING nova.compute.manager [req-687ae329-7988-458c-bb09-f746093f5184 req-8a966c6e-cc02-4a0a-b41e-493b76a3086b service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received unexpected event network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e for instance with vm_state building and task_state spawning.
Aug 01 17:32:40 user nova-compute[72184]: INFO nova.compute.manager [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Took 5.88 seconds to build instance.
Aug 01 17:32:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-22459324-14e1-4ac1-8563-f1b31fbcc3fe tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.973s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:32:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:32:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:32:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:32:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:32:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:54 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:32:56 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:32:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:04 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:09 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:33:21 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:33:21 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:33:21 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.16152572631836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:33:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:33:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:33:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:33:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:33:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:33:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:33:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:33:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:33:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:33:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:33:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:33:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:22 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:23 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:34:23 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.16094207763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:34:23 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:34:24 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:34:24 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:34:24 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:34:24 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:34:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:34:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-changed-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:34:26 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Refreshing instance network info cache due to event network-changed-1059bbd8-99e0-4017-822e-180957522d7e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:34:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:34:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:34:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Refreshing network info cache for port 1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated VIF entry in instance network info cache for port 1059bbd8-99e0-4017-822e-180957522d7e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG nova.network.neutron [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'flavor' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e9e6ac3-b775-4679-94cf-968adff2281b req-ed9dc787-591c-49a7-9a74-182b9718859e service nova] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:34:27 user nova-compute[72184]: INFO nova.compute.manager [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Attaching volume c850cc59-ecda-4b6f-bba9-0e8c954b29cf to /dev/vdb
Aug 01 17:34:27 user nova-compute[72184]: DEBUG os_brick.utils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a130d86-6b7c-4b8e-8c41-9a63f11e43a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f76a83c-59ce-4526-b269-ca790d3c91b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0588214-db5a-42d0-bf66-0d65b522f0e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb91e7-9662-4a7b-bd17-b2cb8b9026a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:34:27 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:34:27 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf03e9-4744-4cf3-92ab-684899388adc]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG os_brick.utils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:34:27 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating existing volume attachment record: 959fcb65-a4f2-4b4a-8911-3d3e67ee9f8f {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:34:29 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnTQCeVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:34:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:34:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:34:34 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac640225-d019-4985-a3d6-a3a9d1000106]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:34:34 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2f98e-6811-422c-8b72-37580fc74d5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf] added
Aug 01 17:34:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bbf711-7b05-4a66-817e-c13e0853a122]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea99d7d-9a33-4707-93ba-f4618ef44b84]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnTQCeVr {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnTQCeVr" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10b07a6-82af-48cc-84a9-1ecfc48df1e7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XnTQCeVr'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7927efc-2933-4d5f-aba3-c16253ea9207]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaaac00-c6a2-4f22-ab62-532ff52f4486]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:34:34 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:34:34 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:34:34 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:34:34 user nova-compute[72184]: 
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab7d4db-3ffe-4565-86b2-4ed0b494f088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260]
Aug 01 17:34:34 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260] successful.
Aug 01 17:34:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a3460b-0abb-43f1-b6ba-f8b48970aa3b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b6bb9-cc21-4ce5-8892-7fef9b9d2392]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf (non-flash)
Aug 01 17:34:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf (non-flash)
Aug 01 17:34:34 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a4c678-2128-431c-88ec-6e582f84b067]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnTQCeVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:34:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:34:35 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23561646665343634', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:34:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561646665343634', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:34:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'flavor' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:34:35 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:34:35 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:34:35 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:34:35 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:34:35 user nova-compute[72184]:   <serial>c850cc59-ecda-4b6f-bba9-0e8c954b29cf</serial>
Aug 01 17:34:35 user nova-compute[72184]: </disk>
Aug 01 17:34:35 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:34:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:34:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:34:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No VIF found with MAC fa:16:3e:3d:6e:4d, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:34:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-6c8fd0c8-db48-43fa-8df6-437bf1707d46 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.062s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:34:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:34:38 user nova-compute[72184]: INFO nova.compute.manager [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Detaching volume c850cc59-ecda-4b6f-bba9-0e8c954b29cf
Aug 01 17:34:38 user nova-compute[72184]: INFO nova.virt.block_device [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Attempting to driver detach volume c850cc59-ecda-4b6f-bba9-0e8c954b29cf from mountpoint /dev/vdb
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Attempting to detach device vdb from instance aecc6cfa-f081-4536-9d17-aed3be7300e9 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:34:38 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:34:38 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:34:38 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:34:38 user nova-compute[72184]:   <serial>c850cc59-ecda-4b6f-bba9-0e8c954b29cf</serial>
Aug 01 17:34:38 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:34:38 user nova-compute[72184]: </disk>
Aug 01 17:34:38 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:34:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully detached device vdb from instance aecc6cfa-f081-4536-9d17-aed3be7300e9 from the persistent domain config.
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aecc6cfa-f081-4536-9d17-aed3be7300e9 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:34:38 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:34:38 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:34:38 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:34:38 user nova-compute[72184]:   <serial>c850cc59-ecda-4b6f-bba9-0e8c954b29cf</serial>
Aug 01 17:34:38 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:34:38 user nova-compute[72184]: </disk>
Aug 01 17:34:38 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690911278.804954, aecc6cfa-f081-4536-9d17-aed3be7300e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:34:38 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully detached device vdb from instance aecc6cfa-f081-4536-9d17-aed3be7300e9 from the live domain config.
Aug 01 17:34:38 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnTQCeVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:34:38 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85cb5e8-0ce8-4208-9c2e-251a7b4c1e6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c0c77-bc43-4352-8a37-36379591d62d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf (non-flash)
Aug 01 17:34:38 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf (non-flash)
Aug 01 17:34:38 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff83b0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866addb-524b-4e4b-86cb-9f1d8006a686]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa599a4-78b0-448d-947c-ebc29d7e5b1b]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e561569-17e7-439b-96d9-c386858c068f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd8b1cd-3515-421a-8141-9bab4a2dec3a]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc505716-fe41-4377-97f1-469eefa1d1db]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca4887a-a505-4ee6-8434-06e6f00d6aaa]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260]
Aug 01 17:34:39 user nova-compute[72184]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf, portal: 172.16.0.220,3260] successful.
Aug 01 17:34:39 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c850cc59-ecda-4b6f-bba9-0e8c954b29cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6777e-4698-44a0-9915-5ae8d9739480]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] <== disconnect_volume: return (286ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'flavor' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14fb0786-f912-42d8-bcbc-042c174aaf19 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:34:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:44 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:34:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:34:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:34:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:34:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:34:59 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:35:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:35:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:24 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:35:24 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.1597900390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:35:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:35:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:35:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:35:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:35:34 user nova-compute[72184]: INFO nova.compute.manager [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] instance snapshotting
Aug 01 17:35:34 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Beginning live snapshot process
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json -f qcow2 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.131s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprbys2_ly/58342cbbf4c64f71b0ed24b9efe9a0fb.delta 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:35 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprbys2_ly/58342cbbf4c64f71b0ed24b9efe9a0fb.delta 1073741824" returned: 0 in 0.055s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:35 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 17:35:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 17:35:36 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 17:35:36 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 17:35:36 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:35:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprbys2_ly/58342cbbf4c64f71b0ed24b9efe9a0fb.delta /opt/stack/data/nova/instances/snapshots/tmprbys2_ly/58342cbbf4c64f71b0ed24b9efe9a0fb {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:37 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprbys2_ly/58342cbbf4c64f71b0ed24b9efe9a0fb.delta /opt/stack/data/nova/instances/snapshots/tmprbys2_ly/58342cbbf4c64f71b0ed24b9efe9a0fb" returned: 0 in 0.626s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:37 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Snapshot extracted, beginning image upload
Aug 01 17:35:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:35:39 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Snapshot image upload complete
Aug 01 17:35:39 user nova-compute[72184]: INFO nova.compute.manager [None req-edd72cfc-2964-435a-b9a1-76c3b31bfcc2 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Took 4.95 seconds to snapshot the instance on the hypervisor.
Aug 01 17:35:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:35:42 user nova-compute[72184]: INFO nova.compute.claims [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Claim successful on node user
Aug 01 17:35:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.network.neutron [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:35:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.policy [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0741810d24e4d5a9ee088075d9b7696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deafde8a71cd4d2b8d67c024340dcb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:35:42 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Creating image(s)
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "/opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "/opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "/opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "dc2f04c1dd2a22f9797bb49702301c4d77e91168" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "dc2f04c1dd2a22f9797bb49702301c4d77e91168" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.part --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG nova.network.neutron [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Successfully created port: 50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.part --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG nova.virt.images [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] b11695ac-0b2b-467e-a81e-6026c6c61b5f was qcow2, converting to raw {{(pid=72184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG nova.privsep.utils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 17:35:43 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.part /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.converted {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.part /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.converted" returned: 0 in 0.682s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.converted --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "dc2f04c1dd2a22f9797bb49702301c4d77e91168" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.911s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168 --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "dc2f04c1dd2a22f9797bb49702301c4d77e91168" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "dc2f04c1dd2a22f9797bb49702301c4d77e91168" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:44 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Successfully updated port: 50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquired lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-changed-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.compute.manager [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Refreshing instance network info cache due to event network-changed-50c71ffd-98c0-4154-b249-fdbf0839ac7f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] Acquiring lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168 --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168,backing_fmt=raw /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168,backing_fmt=raw /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk 1073741824" returned: 0 in 0.050s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "dc2f04c1dd2a22f9797bb49702301c4d77e91168" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc2f04c1dd2a22f9797bb49702301c4d77e91168 --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'migration_context' on Instance uuid 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Ensure instance console log exists: /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.neutron [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating instance_info_cache with network_info: [{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Releasing lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Instance network_info: |[{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] Acquired lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.neutron [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Refreshing network info cache for port 50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Start _get_guest_xml network_info=[{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='77b28aba94a57c2b71770cd027ec3c70',container_format='bare',created_at=2023-08-01T17:35:35Z,direct_url=<?>,disk_format='qcow2',id=b11695ac-0b2b-467e-a81e-6026c6c61b5f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1247271766',owner='deafde8a71cd4d2b8d67c024340dcb54',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T17:35:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'b11695ac-0b2b-467e-a81e-6026c6c61b5f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:35:45 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:35:45 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='77b28aba94a57c2b71770cd027ec3c70',container_format='bare',created_at=2023-08-01T17:35:35Z,direct_url=<?>,disk_format='qcow2',id=b11695ac-0b2b-467e-a81e-6026c6c61b5f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1247271766',owner='deafde8a71cd4d2b8d67c024340dcb54',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T17:35:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-279157168',display_name='tempest-TestStampPattern-server-279157168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-279157168',id=51,image_ref='b11695ac-0b2b-467e-a81e-6026c6c61b5f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWc3KYDksRWsz48abgoVGeVdd8Hqlm3MoxzJEjhVD2D/Hx7WdRAoTyYk+0isKOGHdGpM9Ne9NInMyNnXYIo2sIfH/6byQBxLMJ7nlt/0rG06VW9rST3AG44pnO4LXJajQ==',key_name='tempest-TestStampPattern-2050421810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deafde8a71cd4d2b8d67c024340dcb54',ramdisk_id='',reservation_id='r-uvsruc6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='aecc6cfa-f081-4536-9d17-aed3be7300e9',image_min_disk='1',image_min_ram='0',image_owner_id='deafde8a71cd4d2b8d67c024340dcb54',image_owner_project_name='tempest-TestStampPattern-549477285',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-549477285-project-member',image_user_id='e0741810d24e4d5a9ee088075d9b7696',network_allocated='True',owner_project_name='tempest-TestStampPattern-549477285',owner_user_name='tempest-TestStampPattern-549477285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:35:43Z,user_data=None,user_id='e0741810d24e4d5a9ee088075d9b7696',uuid=776d7641-7322-4bb1-a7e8-0142f9237f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converting VIF {"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'pci_devices' on Instance uuid 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:35:45 user nova-compute[72184]:   <uuid>776d7641-7322-4bb1-a7e8-0142f9237f41</uuid>
Aug 01 17:35:45 user nova-compute[72184]:   <name>instance-00000033</name>
Aug 01 17:35:45 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:35:45 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:35:45 user nova-compute[72184]:   <metadata>
Aug 01 17:35:45 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:35:45 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:35:45 user nova-compute[72184]:       <nova:name>tempest-TestStampPattern-server-279157168</nova:name>
Aug 01 17:35:45 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:35:45</nova:creationTime>
Aug 01 17:35:45 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:35:45 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:35:45 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:35:45 user nova-compute[72184]:       <nova:owner>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:user uuid="e0741810d24e4d5a9ee088075d9b7696">tempest-TestStampPattern-549477285-project-member</nova:user>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:project uuid="deafde8a71cd4d2b8d67c024340dcb54">tempest-TestStampPattern-549477285</nova:project>
Aug 01 17:35:45 user nova-compute[72184]:       </nova:owner>
Aug 01 17:35:45 user nova-compute[72184]:       <nova:root type="image" uuid="b11695ac-0b2b-467e-a81e-6026c6c61b5f"/>
Aug 01 17:35:45 user nova-compute[72184]:       <nova:ports>
Aug 01 17:35:45 user nova-compute[72184]:         <nova:port uuid="50c71ffd-98c0-4154-b249-fdbf0839ac7f">
Aug 01 17:35:45 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 17:35:45 user nova-compute[72184]:         </nova:port>
Aug 01 17:35:45 user nova-compute[72184]:       </nova:ports>
Aug 01 17:35:45 user nova-compute[72184]:     </nova:instance>
Aug 01 17:35:45 user nova-compute[72184]:   </metadata>
Aug 01 17:35:45 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:35:45 user nova-compute[72184]:     <system>
Aug 01 17:35:45 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:35:45 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:35:45 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:35:45 user nova-compute[72184]:       <entry name="serial">776d7641-7322-4bb1-a7e8-0142f9237f41</entry>
Aug 01 17:35:45 user nova-compute[72184]:       <entry name="uuid">776d7641-7322-4bb1-a7e8-0142f9237f41</entry>
Aug 01 17:35:45 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:35:45 user nova-compute[72184]:     </system>
Aug 01 17:35:45 user nova-compute[72184]:   </sysinfo>
Aug 01 17:35:45 user nova-compute[72184]:   <os>
Aug 01 17:35:45 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:35:45 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:35:45 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:35:45 user nova-compute[72184]:   </os>
Aug 01 17:35:45 user nova-compute[72184]:   <features>
Aug 01 17:35:45 user nova-compute[72184]:     <acpi/>
Aug 01 17:35:45 user nova-compute[72184]:     <apic/>
Aug 01 17:35:45 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:35:45 user nova-compute[72184]:   </features>
Aug 01 17:35:45 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:35:45 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:35:45 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:35:45 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:35:45 user nova-compute[72184]:   </clock>
Aug 01 17:35:45 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:35:45 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:35:45 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:35:45 user nova-compute[72184]:   </cpu>
Aug 01 17:35:45 user nova-compute[72184]:   <devices>
Aug 01 17:35:45 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:35:45 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:35:45 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk"/>
Aug 01 17:35:45 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:35:45 user nova-compute[72184]:     </disk>
Aug 01 17:35:45 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:35:45 user nova-compute[72184]:       <mac address="fa:16:3e:d2:8d:db"/>
Aug 01 17:35:45 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:35:45 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:35:45 user nova-compute[72184]:       <target dev="tap50c71ffd-98"/>
Aug 01 17:35:45 user nova-compute[72184]:     </interface>
Aug 01 17:35:45 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:35:45 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/console.log" append="off"/>
Aug 01 17:35:45 user nova-compute[72184]:     </serial>
Aug 01 17:35:45 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:35:45 user nova-compute[72184]:     <video>
Aug 01 17:35:45 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:35:45 user nova-compute[72184]:     </video>
Aug 01 17:35:45 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:35:45 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:35:45 user nova-compute[72184]:     </rng>
Aug 01 17:35:45 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:35:45 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:35:45 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:35:45 user nova-compute[72184]:     </memballoon>
Aug 01 17:35:45 user nova-compute[72184]:   </devices>
Aug 01 17:35:45 user nova-compute[72184]: </domain>
Aug 01 17:35:45 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-279157168',display_name='tempest-TestStampPattern-server-279157168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-279157168',id=51,image_ref='b11695ac-0b2b-467e-a81e-6026c6c61b5f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWc3KYDksRWsz48abgoVGeVdd8Hqlm3MoxzJEjhVD2D/Hx7WdRAoTyYk+0isKOGHdGpM9Ne9NInMyNnXYIo2sIfH/6byQBxLMJ7nlt/0rG06VW9rST3AG44pnO4LXJajQ==',key_name='tempest-TestStampPattern-2050421810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deafde8a71cd4d2b8d67c024340dcb54',ramdisk_id='',reservation_id='r-uvsruc6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='aecc6cfa-f081-4536-9d17-aed3be7300e9',image_min_disk='1',image_min_ram='0',image_owner_id='deafde8a71cd4d2b8d67c024340dcb54',image_owner_project_name='tempest-TestStampPattern-549477285',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-549477285-project-member',image_user_id='e0741810d24e4d5a9ee088075d9b7696',network_allocated='True',owner_project_name='tempest-TestStampPattern-549477285',owner_user_name='tempest-TestStampPattern-549477285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:35:43Z,user_data=None,user_id='e0741810d24e4d5a9ee088075d9b7696',uuid=776d7641-7322-4bb1-a7e8-0142f9237f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converting VIF {"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG os_vif [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c71ffd-98, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50c71ffd-98, col_values=(('external_ids', {'iface-id': '50c71ffd-98c0-4154-b249-fdbf0839ac7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:8d:db', 'vm-uuid': '776d7641-7322-4bb1-a7e8-0142f9237f41'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:45 user nova-compute[72184]: INFO os_vif [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98')
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:35:45 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No VIF found with MAC fa:16:3e:d2:8d:db, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:35:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updated VIF entry in instance network info cache for port 50c71ffd-98c0-4154-b249-fdbf0839ac7f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:35:46 user nova-compute[72184]: DEBUG nova.network.neutron [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating instance_info_cache with network_info: [{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:35:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7d54e3c5-3b26-4e02-92d2-456617e70649 req-69bb78c4-43ca-4b2a-8a6d-37a09a39a591 service nova] Releasing lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:35:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-f5bfa406-0102-4155-9c89-1096e7f3a36d req-c1e6f8f6-d8a7-4c1e-b022-8226b939f645 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:35:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f5bfa406-0102-4155-9c89-1096e7f3a36d req-c1e6f8f6-d8a7-4c1e-b022-8226b939f645 service nova] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f5bfa406-0102-4155-9c89-1096e7f3a36d req-c1e6f8f6-d8a7-4c1e-b022-8226b939f645 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:47 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f5bfa406-0102-4155-9c89-1096e7f3a36d req-c1e6f8f6-d8a7-4c1e-b022-8226b939f645 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:47 user nova-compute[72184]: DEBUG nova.compute.manager [req-f5bfa406-0102-4155-9c89-1096e7f3a36d req-c1e6f8f6-d8a7-4c1e-b022-8226b939f645 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] No waiting events found dispatching network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:35:47 user nova-compute[72184]: WARNING nova.compute.manager [req-f5bfa406-0102-4155-9c89-1096e7f3a36d req-c1e6f8f6-d8a7-4c1e-b022-8226b939f645 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received unexpected event network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f for instance with vm_state building and task_state spawning.
Aug 01 17:35:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690911348.9694948, 776d7641-7322-4bb1-a7e8-0142f9237f41 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:35:48 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] VM Resumed (Lifecycle Event)
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:35:48 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Instance spawned successfully.
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:35:48 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:35:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:35:49 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690911348.9707444, 776d7641-7322-4bb1-a7e8-0142f9237f41 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:35:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] VM Started (Lifecycle Event)
Aug 01 17:35:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:35:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:35:49 user nova-compute[72184]: INFO nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 01 17:35:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:35:49 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:35:49 user nova-compute[72184]: DEBUG nova.compute.manager [req-f6ef173d-c95c-410d-9865-865eff1abfde req-01d30a6b-da7e-4741-b415-5d636ccb62d5 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:35:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f6ef173d-c95c-410d-9865-865eff1abfde req-01d30a6b-da7e-4741-b415-5d636ccb62d5 service nova] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:35:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f6ef173d-c95c-410d-9865-865eff1abfde req-01d30a6b-da7e-4741-b415-5d636ccb62d5 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:35:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f6ef173d-c95c-410d-9865-865eff1abfde req-01d30a6b-da7e-4741-b415-5d636ccb62d5 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:49 user nova-compute[72184]: DEBUG nova.compute.manager [req-f6ef173d-c95c-410d-9865-865eff1abfde req-01d30a6b-da7e-4741-b415-5d636ccb62d5 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] No waiting events found dispatching network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:35:49 user nova-compute[72184]: WARNING nova.compute.manager [req-f6ef173d-c95c-410d-9865-865eff1abfde req-01d30a6b-da7e-4741-b415-5d636ccb62d5 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received unexpected event network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f for instance with vm_state building and task_state spawning.
Aug 01 17:35:49 user nova-compute[72184]: INFO nova.compute.manager [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Took 7.15 seconds to build instance.
Aug 01 17:35:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-963d81e9-a166-4427-bbfa-ea6636b49905 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.245s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:35:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:35:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:35:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:35:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:35:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:36:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:36:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:23 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:36:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:36:25 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:36:25 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=25.013599395751953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 776d7641-7322-4bb1-a7e8-0142f9237f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:36:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:36:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:36:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:36:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:36:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:36:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:36:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:36:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:36:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:37:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:37:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:37:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:24 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:25 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:26 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:37:26 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.01288604736328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 776d7641-7322-4bb1-a7e8-0142f9237f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:37:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating instance_info_cache with network_info: [{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:37:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:37:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-changed-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:37:33 user nova-compute[72184]: DEBUG nova.compute.manager [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Refreshing instance network info cache due to event network-changed-50c71ffd-98c0-4154-b249-fdbf0839ac7f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:37:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] Acquiring lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:37:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] Acquired lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:37:33 user nova-compute[72184]: DEBUG nova.network.neutron [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Refreshing network info cache for port 50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updated VIF entry in instance network info cache for port 50c71ffd-98c0-4154-b249-fdbf0839ac7f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG nova.network.neutron [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating instance_info_cache with network_info: [{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-aabbf1dc-c340-425d-b4ef-1bf9c3bc87b5 req-6e8223dd-b208-4592-a1a0-9e9e95d81558 service nova] Releasing lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'flavor' on Instance uuid 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:37:34 user nova-compute[72184]: INFO nova.compute.manager [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Attaching volume 301c0248-021c-4685-b433-4cc4dd8deb15 to /dev/vdb
Aug 01 17:37:34 user nova-compute[72184]: DEBUG os_brick.utils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[165c92c2-74f5-489d-9024-58b67f993c9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7bb580-7eb2-4d8c-85bc-b0a32190c34f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1efa475-a6f0-47ad-b48b-8c1bab383ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95dd3dc-a6a1-4874-aa97-b996a8ed2ea5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:37:34 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:37:34 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98046291-7139-40d0-9d8d-7fa8d1b43232]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG os_brick.utils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:37:34 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating existing volume attachment record: 41a9a26d-bd4e-430a-842e-b3679167112c {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:37:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:37:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHumrjCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:37:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:37:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:37:46 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d56bc-5e1c-401d-ba25-4648f975fd42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:37:46 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a843c4c-1fbf-42f0-9bae-632be7ef6638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15] added
Aug 01 17:37:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a516fb34-b4e1-425d-88d8-45c3d7d6dbed]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e679efd8-fd68-48c8-ad05-f9fcb83b3dac]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHumrjCS {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHumrjCS" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7f918-5c87-4d19-8761-e0264a53881e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHumrjCS'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dae59e-1990-4a37-af80-38d462ee4684]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d1766-3222-4e77-a91c-20183da5fbb7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:37:46 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:37:46 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:37:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:37:46 user nova-compute[72184]: 
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0382d7e2-e155-43f8-84f6-dc8718e3688f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260]
Aug 01 17:37:46 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260] successful.
Aug 01 17:37:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb8b40-fc75-49a6-b301-2813f3378fb9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1d5036-7586-4f12-8789-e13dca43e9a7]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 (non-flash)
Aug 01 17:37:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 (non-flash)
Aug 01 17:37:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762cb32-e97e-4081-9722-82aa39b54e5e]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:37:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHumrjCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:37:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:37:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26264646262373330', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:37:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264646262373330', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:37:47 user nova-compute[72184]: DEBUG nova.objects.instance [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'flavor' on Instance uuid 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:37:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:37:47 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:37:47 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:37:47 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:37:47 user nova-compute[72184]:   <serial>301c0248-021c-4685-b433-4cc4dd8deb15</serial>
Aug 01 17:37:47 user nova-compute[72184]: </disk>
Aug 01 17:37:47 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:37:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:37:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:37:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] No VIF found with MAC fa:16:3e:d2:8d:db, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:37:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-54adad24-35da-4d4a-ba95-9017e4a5221b tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.697s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:37:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:37:49 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:37:49 user nova-compute[72184]: INFO nova.compute.manager [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Detaching volume 301c0248-021c-4685-b433-4cc4dd8deb15
Aug 01 17:37:49 user nova-compute[72184]: INFO nova.virt.block_device [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Attempting to driver detach volume 301c0248-021c-4685-b433-4cc4dd8deb15 from mountpoint /dev/vdb
Aug 01 17:37:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Attempting to detach device vdb from instance 776d7641-7322-4bb1-a7e8-0142f9237f41 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:37:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:37:49 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:37:49 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:37:49 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:37:49 user nova-compute[72184]:   <serial>301c0248-021c-4685-b433-4cc4dd8deb15</serial>
Aug 01 17:37:49 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:37:49 user nova-compute[72184]: </disk>
Aug 01 17:37:49 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:37:49 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully detached device vdb from instance 776d7641-7322-4bb1-a7e8-0142f9237f41 from the persistent domain config.
Aug 01 17:37:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 776d7641-7322-4bb1-a7e8-0142f9237f41 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:37:49 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:37:49 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:37:49 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:37:49 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:37:49 user nova-compute[72184]:   <serial>301c0248-021c-4685-b433-4cc4dd8deb15</serial>
Aug 01 17:37:49 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:37:49 user nova-compute[72184]: </disk>
Aug 01 17:37:49 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690911470.1444204, 776d7641-7322-4bb1-a7e8-0142f9237f41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:37:50 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully detached device vdb from instance 776d7641-7322-4bb1-a7e8-0142f9237f41 from the live domain config.
Aug 01 17:37:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHumrjCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:37:50 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b402eff-b9d0-48bb-8917-f19c7aa64842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa00eef-cb7d-4096-b89b-f649479a82b6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 (non-flash)
Aug 01 17:37:50 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 (non-flash)
Aug 01 17:37:50 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301c4d2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4407e92d-934e-4473-b8c6-dfa85da80832]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db94aba-05f3-4892-9077-a7f9992eb1d0]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e078c-1475-4d05-97d8-e7017c2c518a]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0534da72-d329-4166-a305-910f549351d4]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020cdd0-f8eb-4be1-90b4-29f2bceae067]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c4ff1-354f-4bb5-b8fc-939f1c4f1ecc]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260]
Aug 01 17:37:50 user nova-compute[72184]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15, portal: 172.16.0.220,3260] successful.
Aug 01 17:37:50 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c0248-021c-4685-b433-4cc4dd8deb15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ad456-b2a1-4fea-818e-ab6bc5af1dec]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] <== disconnect_volume: return (278ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:37:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:37:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'flavor' on Instance uuid 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:37:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-c8174ba1-842e-47c3-b352-3fd847bf1446 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:37:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:37:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:37:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:37:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:09 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:38:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:38:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:38:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:38:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:38:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:38:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:38:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:38:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:38:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:25 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:38:26 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:38:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:38:28 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:38:28 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:38:28 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.01169204711914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 776d7641-7322-4bb1-a7e8-0142f9237f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:38:28 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:38:29 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:38:29 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:38:29 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:38:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:33 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:38:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:38:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-changed-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Refreshing instance network info cache due to event network-changed-50c71ffd-98c0-4154-b249-fdbf0839ac7f. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] Acquiring lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] Acquired lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Refreshing network info cache for port 50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:40 user nova-compute[72184]: INFO nova.compute.manager [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Terminating instance
Aug 01 17:38:40 user nova-compute[72184]: DEBUG nova.compute.manager [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updated VIF entry in instance network info cache for port 50c71ffd-98c0-4154-b249-fdbf0839ac7f. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating instance_info_cache with network_info: [{"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:38:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7a8e3d7b-d6fe-4d5a-b530-219df16cb1ee req-8a11b021-6dfd-4bca-97d8-d0f543e35ce0 service nova] Releasing lock "refresh_cache-776d7641-7322-4bb1-a7e8-0142f9237f41" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e3aeb5c-628f-47df-8034-86c7a8237ee2 req-d4185d10-2d00-44af-b035-e1604957d3c9 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-vif-unplugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e3aeb5c-628f-47df-8034-86c7a8237ee2 req-d4185d10-2d00-44af-b035-e1604957d3c9 service nova] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e3aeb5c-628f-47df-8034-86c7a8237ee2 req-d4185d10-2d00-44af-b035-e1604957d3c9 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-2e3aeb5c-628f-47df-8034-86c7a8237ee2 req-d4185d10-2d00-44af-b035-e1604957d3c9 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e3aeb5c-628f-47df-8034-86c7a8237ee2 req-d4185d10-2d00-44af-b035-e1604957d3c9 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] No waiting events found dispatching network-vif-unplugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-2e3aeb5c-628f-47df-8034-86c7a8237ee2 req-d4185d10-2d00-44af-b035-e1604957d3c9 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-vif-unplugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:38:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Instance destroyed successfully.
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.objects.instance [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'resources' on Instance uuid 776d7641-7322-4bb1-a7e8-0142f9237f41 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-279157168',display_name='tempest-TestStampPattern-server-279157168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-279157168',id=51,image_ref='b11695ac-0b2b-467e-a81e-6026c6c61b5f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWc3KYDksRWsz48abgoVGeVdd8Hqlm3MoxzJEjhVD2D/Hx7WdRAoTyYk+0isKOGHdGpM9Ne9NInMyNnXYIo2sIfH/6byQBxLMJ7nlt/0rG06VW9rST3AG44pnO4LXJajQ==',key_name='tempest-TestStampPattern-2050421810',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deafde8a71cd4d2b8d67c024340dcb54',ramdisk_id='',reservation_id='r-uvsruc6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='aecc6cfa-f081-4536-9d17-aed3be7300e9',image_min_disk='1',image_min_ram='0',image_owner_id='deafde8a71cd4d2b8d67c024340dcb54',image_owner_project_name='tempest-TestStampPattern-549477285',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-549477285-project-member',image_user_id='e0741810d24e4d5a9ee088075d9b7696',owner_project_name='tempest-TestStampPattern-549477285',owner_user_name='tempest-TestStampPattern-549477285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:35:49Z,user_data=None,user_id='e0741810d24e4d5a9ee088075d9b7696',uuid=776d7641-7322-4bb1-a7e8-0142f9237f41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converting VIF {"id": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "address": "fa:16:3e:d2:8d:db", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c71ffd-98", "ovs_interfaceid": "50c71ffd-98c0-4154-b249-fdbf0839ac7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG os_vif [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c71ffd-98, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:41 user nova-compute[72184]: INFO os_vif [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:8d:db,bridge_name='br-int',has_traffic_filtering=True,id=50c71ffd-98c0-4154-b249-fdbf0839ac7f,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c71ffd-98')
Aug 01 17:38:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Deleting instance files /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41_del
Aug 01 17:38:41 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Deletion of /opt/stack/data/nova/instances/776d7641-7322-4bb1-a7e8-0142f9237f41_del complete
Aug 01 17:38:41 user nova-compute[72184]: INFO nova.compute.manager [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:38:41 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Took 0.54 seconds to deallocate network for instance.
Aug 01 17:38:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-71dd0174-b687-49bd-9957-16314873aea9 req-6f16fe61-e8a7-47f0-aeae-23431f33ea09 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-vif-deleted-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:42 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:38:42 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:38:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:42 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Deleted allocations for instance 776d7641-7322-4bb1-a7e8-0142f9237f41
Aug 01 17:38:42 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-25557456-2ada-472a-9b42-dad9a0e29fe0 tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.766s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f462538-6bfe-470a-a7c0-71f229c10558 req-dc31d93e-edba-48a2-aff4-6ae7e6b70217 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received event network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:38:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f462538-6bfe-470a-a7c0-71f229c10558 req-dc31d93e-edba-48a2-aff4-6ae7e6b70217 service nova] Acquiring lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:38:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f462538-6bfe-470a-a7c0-71f229c10558 req-dc31d93e-edba-48a2-aff4-6ae7e6b70217 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:38:43 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f462538-6bfe-470a-a7c0-71f229c10558 req-dc31d93e-edba-48a2-aff4-6ae7e6b70217 service nova] Lock "776d7641-7322-4bb1-a7e8-0142f9237f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:38:43 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f462538-6bfe-470a-a7c0-71f229c10558 req-dc31d93e-edba-48a2-aff4-6ae7e6b70217 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] No waiting events found dispatching network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:38:43 user nova-compute[72184]: WARNING nova.compute.manager [req-0f462538-6bfe-470a-a7c0-71f229c10558 req-dc31d93e-edba-48a2-aff4-6ae7e6b70217 service nova] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Received unexpected event network-vif-plugged-50c71ffd-98c0-4154-b249-fdbf0839ac7f for instance with vm_state deleted and task_state None.
Aug 01 17:38:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:38:49 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:38:49 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:38:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:38:56 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690911521.2767017, 776d7641-7322-4bb1-a7e8-0142f9237f41 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:38:56 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] VM Stopped (Lifecycle Event)
Aug 01 17:38:56 user nova-compute[72184]: DEBUG nova.compute.manager [None req-a52ecabc-1dda-478c-9cef-4a48382b8e4c None None] [instance: 776d7641-7322-4bb1-a7e8-0142f9237f41] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:38:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:39:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:08 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:08 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Triggering sync for uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 17:39:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:08 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:09 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:39:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:39:27 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:39:27 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.0123291015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:39:27 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:39:28 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:39:28 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:39:28 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:39:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:39:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:39:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:39:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:39:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-changed-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Refreshing instance network info cache due to event network-changed-1059bbd8-99e0-4017-822e-180957522d7e. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] Acquiring lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] Acquired lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Refreshing network info cache for port 1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:39 user nova-compute[72184]: INFO nova.compute.manager [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Terminating instance
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.compute.manager [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f0ee604-ca1b-41b4-b73a-0c4ec743c152 req-1946b7fa-8b2c-431f-931e-bf1985d2c114 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-vif-unplugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f0ee604-ca1b-41b4-b73a-0c4ec743c152 req-1946b7fa-8b2c-431f-931e-bf1985d2c114 service nova] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f0ee604-ca1b-41b4-b73a-0c4ec743c152 req-1946b7fa-8b2c-431f-931e-bf1985d2c114 service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-0f0ee604-ca1b-41b4-b73a-0c4ec743c152 req-1946b7fa-8b2c-431f-931e-bf1985d2c114 service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f0ee604-ca1b-41b4-b73a-0c4ec743c152 req-1946b7fa-8b2c-431f-931e-bf1985d2c114 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] No waiting events found dispatching network-vif-unplugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.compute.manager [req-0f0ee604-ca1b-41b4-b73a-0c4ec743c152 req-1946b7fa-8b2c-431f-931e-bf1985d2c114 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-vif-unplugged-1059bbd8-99e0-4017-822e-180957522d7e for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updated VIF entry in instance network info cache for port 1059bbd8-99e0-4017-822e-180957522d7e. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG nova.network.neutron [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [{"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-d23cbc08-1c81-40e0-999d-4d5ac4006a91 req-f4be9ce0-4e00-49d3-9f31-bf45c5e0d44f service nova] Releasing lock "refresh_cache-aecc6cfa-f081-4536-9d17-aed3be7300e9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:39:39 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Instance destroyed successfully.
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.objects.instance [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lazy-loading 'resources' on Instance uuid aecc6cfa-f081-4536-9d17-aed3be7300e9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:32:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1220250029',display_name='tempest-TestStampPattern-server-1220250029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1220250029',id=50,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWc3KYDksRWsz48abgoVGeVdd8Hqlm3MoxzJEjhVD2D/Hx7WdRAoTyYk+0isKOGHdGpM9Ne9NInMyNnXYIo2sIfH/6byQBxLMJ7nlt/0rG06VW9rST3AG44pnO4LXJajQ==',key_name='tempest-TestStampPattern-2050421810',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:32:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deafde8a71cd4d2b8d67c024340dcb54',ramdisk_id='',reservation_id='r-huiwskkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-549477285',owner_user_name='tempest-TestStampPattern-549477285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:35:40Z,user_data=None,user_id='e0741810d24e4d5a9ee088075d9b7696',uuid=aecc6cfa-f081-4536-9d17-aed3be7300e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converting VIF {"id": "1059bbd8-99e0-4017-822e-180957522d7e", "address": "fa:16:3e:3d:6e:4d", "network": {"id": "e5342fa9-c352-4064-b10d-360568fb3ac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1088523382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deafde8a71cd4d2b8d67c024340dcb54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1059bbd8-99", "ovs_interfaceid": "1059bbd8-99e0-4017-822e-180957522d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG os_vif [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1059bbd8-99, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:40 user nova-compute[72184]: INFO os_vif [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:6e:4d,bridge_name='br-int',has_traffic_filtering=True,id=1059bbd8-99e0-4017-822e-180957522d7e,network=Network(e5342fa9-c352-4064-b10d-360568fb3ac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1059bbd8-99')
Aug 01 17:39:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Deleting instance files /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9_del
Aug 01 17:39:40 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Deletion of /opt/stack/data/nova/instances/aecc6cfa-f081-4536-9d17-aed3be7300e9_del complete
Aug 01 17:39:40 user nova-compute[72184]: INFO nova.compute.manager [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 17:39:40 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:39:40 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Took 0.50 seconds to deallocate network for instance.
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-26bce5e8-c2af-402f-8991-c27f19a57f1b req-2f4819a8-1a9d-43a7-9429-5cb9282fe865 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-vif-deleted-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:39:40 user nova-compute[72184]: INFO nova.compute.manager [req-26bce5e8-c2af-402f-8991-c27f19a57f1b req-2f4819a8-1a9d-43a7-9429-5cb9282fe865 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Neutron deleted interface 1059bbd8-99e0-4017-822e-180957522d7e; detaching it from the instance and deleting it from the info cache
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.network.neutron [req-26bce5e8-c2af-402f-8991-c27f19a57f1b req-2f4819a8-1a9d-43a7-9429-5cb9282fe865 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.compute.manager [req-26bce5e8-c2af-402f-8991-c27f19a57f1b req-2f4819a8-1a9d-43a7-9429-5cb9282fe865 service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Detach interface failed, port_id=1059bbd8-99e0-4017-822e-180957522d7e, reason: Instance aecc6cfa-f081-4536-9d17-aed3be7300e9 could not be found. {{(pid=72184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:39:40 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:39:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:41 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Deleted allocations for instance aecc6cfa-f081-4536-9d17-aed3be7300e9
Aug 01 17:39:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-85fac889-bfdd-4860-b39d-bf9ee4a1f43f tempest-TestStampPattern-549477285 tempest-TestStampPattern-549477285-project-member] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.636s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-a92e32b5-55da-4609-b587-42eb090dd6aa req-f3aa5f94-1c6a-4b6f-b680-73d03e18c63a service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received event network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:39:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a92e32b5-55da-4609-b587-42eb090dd6aa req-f3aa5f94-1c6a-4b6f-b680-73d03e18c63a service nova] Acquiring lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:39:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a92e32b5-55da-4609-b587-42eb090dd6aa req-f3aa5f94-1c6a-4b6f-b680-73d03e18c63a service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:39:41 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-a92e32b5-55da-4609-b587-42eb090dd6aa req-f3aa5f94-1c6a-4b6f-b680-73d03e18c63a service nova] Lock "aecc6cfa-f081-4536-9d17-aed3be7300e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:39:41 user nova-compute[72184]: DEBUG nova.compute.manager [req-a92e32b5-55da-4609-b587-42eb090dd6aa req-f3aa5f94-1c6a-4b6f-b680-73d03e18c63a service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] No waiting events found dispatching network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:39:41 user nova-compute[72184]: WARNING nova.compute.manager [req-a92e32b5-55da-4609-b587-42eb090dd6aa req-f3aa5f94-1c6a-4b6f-b680-73d03e18c63a service nova] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Received unexpected event network-vif-plugged-1059bbd8-99e0-4017-822e-180957522d7e for instance with vm_state deleted and task_state None.
Aug 01 17:39:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:39:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690911580.2443979, aecc6cfa-f081-4536-9d17-aed3be7300e9 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:39:55 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] VM Stopped (Lifecycle Event)
Aug 01 17:39:55 user nova-compute[72184]: DEBUG nova.compute.manager [None req-de718f16-092a-4fe9-a377-57c714d8d7e0 None None] [instance: aecc6cfa-f081-4536-9d17-aed3be7300e9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:39:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:40:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:40:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:40:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:40:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:40:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:40:27 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:40:28 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:40:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:40:29 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:40:29 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.136962890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:40:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:40:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:40:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:34 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:40:39 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:40 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:40:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:40:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:40:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:40:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:40:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:40:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:40:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:41:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:41:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:10 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Starting instance... {{(pid=72184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 17:41:23 user nova-compute[72184]: INFO nova.compute.claims [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Claim successful on node user
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Start building networks asynchronously for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Allocating IP information in the background. {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] allocate_for_instance() {{(pid=72184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 17:41:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Start building block device mappings for instance. {{(pid=72184) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.policy [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0594bd534aff4934bd10c25d68f00e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0be8a37e7148c88948ac1669389a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72184) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Start spawning the instance on the hypervisor. {{(pid=72184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Creating instance directory {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 17:41:23 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Creating image(s)
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "/opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "/opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:23 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "/opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.143s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk 1073741824 {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080,backing_fmt=raw /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk 1073741824" returned: 0 in 0.053s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "5cc2fcceabfc13bc1a1ff065c8028a4bba215080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cc2fcceabfc13bc1a1ff065c8028a4bba215080 --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk. size=1073741824 {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Successfully created port: 76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG nova.virt.disk.api [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Cannot resize image /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk to a smaller size. {{(pid=72184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'migration_context' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Created local disks {{(pid=72184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Ensure instance console log exists: /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/console.log {{(pid=72184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Successfully updated port: 76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Building network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Instance cache missing network info. {{(pid=72184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-changed-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.compute.manager [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Refreshing instance network info cache due to event network-changed-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.network.neutron [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Instance network_info: |[{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.network.neutron [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Refreshing network info cache for port 76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Start _get_guest_xml network_info=[{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '445427d2-2c17-4b94-ba10-8b1151983d7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 17:41:25 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:41:25 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CPU controller missing on host. {{(pid=72184) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.host [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CPU controller found on host. {{(pid=72184) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T16:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T16:48:09Z,direct_url=<?>,disk_format='qcow2',id=445427d2-2c17-4b94-ba10-8b1151983d7e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e6b7a4186dbd44e59c7f59cf41ff19b0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T16:48:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Flavor limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Image limits 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Flavor pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Image pref 0:0:0 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Got 1 possible topologies {{(pid=72184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 17:41:25 user nova-compute[72184]: DEBUG nova.virt.hardware [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1105224371',display_name='tempest-SnapshotDataIntegrityTests-server-1105224371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1105224371',id=52,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTARVG+O82ti1bc0OrrD5abpA3UXMkd3WL/M+9vANpNGYXOxIjF3JZAR1iLa5Jokct620L1Tz0V5M3jdNW7FRXePE91VPBWfrQNa+s8cH3ByI0HUZnH3g30mbR1zVkhYw==',key_name='tempest-keypair-765723039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0be8a37e7148c88948ac1669389a51',ramdisk_id='',reservation_id='r-z0jp6v14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-633366244',owner_user_name='tempest-SnapshotDataIntegrityTests-633366244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0594bd534aff4934bd10c25d68f00e62',uuid=03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Converting VIF {"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.objects.instance [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'pci_devices' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 17:41:26 user nova-compute[72184]:   <uuid>03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9</uuid>
Aug 01 17:41:26 user nova-compute[72184]:   <name>instance-00000034</name>
Aug 01 17:41:26 user nova-compute[72184]:   <memory>524288</memory>
Aug 01 17:41:26 user nova-compute[72184]:   <vcpu>1</vcpu>
Aug 01 17:41:26 user nova-compute[72184]:   <metadata>
Aug 01 17:41:26 user nova-compute[72184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 17:41:26 user nova-compute[72184]:       <nova:package version="0.0.0"/>
Aug 01 17:41:26 user nova-compute[72184]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1105224371</nova:name>
Aug 01 17:41:26 user nova-compute[72184]:       <nova:creationTime>2023-08-01 17:41:25</nova:creationTime>
Aug 01 17:41:26 user nova-compute[72184]:       <nova:flavor name="m1.tiny">
Aug 01 17:41:26 user nova-compute[72184]:         <nova:memory>512</nova:memory>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:disk>1</nova:disk>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:swap>0</nova:swap>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:vcpus>1</nova:vcpus>
Aug 01 17:41:26 user nova-compute[72184]:       </nova:flavor>
Aug 01 17:41:26 user nova-compute[72184]:       <nova:owner>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:user uuid="0594bd534aff4934bd10c25d68f00e62">tempest-SnapshotDataIntegrityTests-633366244-project-member</nova:user>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:project uuid="2a0be8a37e7148c88948ac1669389a51">tempest-SnapshotDataIntegrityTests-633366244</nova:project>
Aug 01 17:41:26 user nova-compute[72184]:       </nova:owner>
Aug 01 17:41:26 user nova-compute[72184]:       <nova:root type="image" uuid="445427d2-2c17-4b94-ba10-8b1151983d7e"/>
Aug 01 17:41:26 user nova-compute[72184]:       <nova:ports>
Aug 01 17:41:26 user nova-compute[72184]:         <nova:port uuid="76a3c74c-c5d1-46d8-b0e2-2b3ea7183089">
Aug 01 17:41:26 user nova-compute[72184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 17:41:26 user nova-compute[72184]:         </nova:port>
Aug 01 17:41:26 user nova-compute[72184]:       </nova:ports>
Aug 01 17:41:26 user nova-compute[72184]:     </nova:instance>
Aug 01 17:41:26 user nova-compute[72184]:   </metadata>
Aug 01 17:41:26 user nova-compute[72184]:   <sysinfo type="smbios">
Aug 01 17:41:26 user nova-compute[72184]:     <system>
Aug 01 17:41:26 user nova-compute[72184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 17:41:26 user nova-compute[72184]:       <entry name="product">OpenStack Nova</entry>
Aug 01 17:41:26 user nova-compute[72184]:       <entry name="version">0.0.0</entry>
Aug 01 17:41:26 user nova-compute[72184]:       <entry name="serial">03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9</entry>
Aug 01 17:41:26 user nova-compute[72184]:       <entry name="uuid">03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9</entry>
Aug 01 17:41:26 user nova-compute[72184]:       <entry name="family">Virtual Machine</entry>
Aug 01 17:41:26 user nova-compute[72184]:     </system>
Aug 01 17:41:26 user nova-compute[72184]:   </sysinfo>
Aug 01 17:41:26 user nova-compute[72184]:   <os>
Aug 01 17:41:26 user nova-compute[72184]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 17:41:26 user nova-compute[72184]:     <boot dev="hd"/>
Aug 01 17:41:26 user nova-compute[72184]:     <smbios mode="sysinfo"/>
Aug 01 17:41:26 user nova-compute[72184]:   </os>
Aug 01 17:41:26 user nova-compute[72184]:   <features>
Aug 01 17:41:26 user nova-compute[72184]:     <acpi/>
Aug 01 17:41:26 user nova-compute[72184]:     <apic/>
Aug 01 17:41:26 user nova-compute[72184]:     <vmcoreinfo/>
Aug 01 17:41:26 user nova-compute[72184]:   </features>
Aug 01 17:41:26 user nova-compute[72184]:   <clock offset="utc">
Aug 01 17:41:26 user nova-compute[72184]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 17:41:26 user nova-compute[72184]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 17:41:26 user nova-compute[72184]:     <timer name="hpet" present="no"/>
Aug 01 17:41:26 user nova-compute[72184]:   </clock>
Aug 01 17:41:26 user nova-compute[72184]:   <cpu mode="custom" match="exact">
Aug 01 17:41:26 user nova-compute[72184]:     <model>Nehalem</model>
Aug 01 17:41:26 user nova-compute[72184]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 17:41:26 user nova-compute[72184]:   </cpu>
Aug 01 17:41:26 user nova-compute[72184]:   <devices>
Aug 01 17:41:26 user nova-compute[72184]:     <disk type="file" device="disk">
Aug 01 17:41:26 user nova-compute[72184]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 17:41:26 user nova-compute[72184]:       <source file="/opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk"/>
Aug 01 17:41:26 user nova-compute[72184]:       <target dev="vda" bus="virtio"/>
Aug 01 17:41:26 user nova-compute[72184]:     </disk>
Aug 01 17:41:26 user nova-compute[72184]:     <interface type="ethernet">
Aug 01 17:41:26 user nova-compute[72184]:       <mac address="fa:16:3e:c3:97:d4"/>
Aug 01 17:41:26 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:41:26 user nova-compute[72184]:       <mtu size="1442"/>
Aug 01 17:41:26 user nova-compute[72184]:       <target dev="tap76a3c74c-c5"/>
Aug 01 17:41:26 user nova-compute[72184]:     </interface>
Aug 01 17:41:26 user nova-compute[72184]:     <serial type="pty">
Aug 01 17:41:26 user nova-compute[72184]:       <log file="/opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/console.log" append="off"/>
Aug 01 17:41:26 user nova-compute[72184]:     </serial>
Aug 01 17:41:26 user nova-compute[72184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 17:41:26 user nova-compute[72184]:     <video>
Aug 01 17:41:26 user nova-compute[72184]:       <model type="virtio"/>
Aug 01 17:41:26 user nova-compute[72184]:     </video>
Aug 01 17:41:26 user nova-compute[72184]:     <rng model="virtio">
Aug 01 17:41:26 user nova-compute[72184]:       <backend model="random">/dev/urandom</backend>
Aug 01 17:41:26 user nova-compute[72184]:     </rng>
Aug 01 17:41:26 user nova-compute[72184]:     <controller type="usb" index="0" model="none"/>
Aug 01 17:41:26 user nova-compute[72184]:     <memballoon model="virtio">
Aug 01 17:41:26 user nova-compute[72184]:       <stats period="10"/>
Aug 01 17:41:26 user nova-compute[72184]:     </memballoon>
Aug 01 17:41:26 user nova-compute[72184]:   </devices>
Aug 01 17:41:26 user nova-compute[72184]: </domain>
Aug 01 17:41:26 user nova-compute[72184]:  {{(pid=72184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1105224371',display_name='tempest-SnapshotDataIntegrityTests-server-1105224371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1105224371',id=52,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTARVG+O82ti1bc0OrrD5abpA3UXMkd3WL/M+9vANpNGYXOxIjF3JZAR1iLa5Jokct620L1Tz0V5M3jdNW7FRXePE91VPBWfrQNa+s8cH3ByI0HUZnH3g30mbR1zVkhYw==',key_name='tempest-keypair-765723039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0be8a37e7148c88948ac1669389a51',ramdisk_id='',reservation_id='r-z0jp6v14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-633366244',owner_user_name='tempest-SnapshotDataIntegrityTests-633366244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T17:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0594bd534aff4934bd10c25d68f00e62',uuid=03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Converting VIF {"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG os_vif [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5') {{(pid=72184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76a3c74c-c5, may_exist=True, interface_attrs={}) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76a3c74c-c5, col_values=(('external_ids', {'iface-id': '76a3c74c-c5d1-46d8-b0e2-2b3ea7183089', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:97:d4', 'vm-uuid': '03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9'}),), if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:26 user nova-compute[72184]: INFO os_vif [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5')
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No VIF found with MAC fa:16:3e:c3:97:d4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated VIF entry in instance network info cache for port 76a3c74c-c5d1-46d8-b0e2-2b3ea7183089. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG nova.network.neutron [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:41:26 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-57b56b63-b4c6-4782-b173-5f077d1a8aa2 req-00959073-ce86-4bff-8abe-f2975334d920 service nova] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-311264bc-0920-48e0-880a-b9213402cd9e req-0bd14626-2020-43c8-99b7-44d9454db785 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-311264bc-0920-48e0-880a-b9213402cd9e req-0bd14626-2020-43c8-99b7-44d9454db785 service nova] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-311264bc-0920-48e0-880a-b9213402cd9e req-0bd14626-2020-43c8-99b7-44d9454db785 service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-311264bc-0920-48e0-880a-b9213402cd9e req-0bd14626-2020-43c8-99b7-44d9454db785 service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:27 user nova-compute[72184]: DEBUG nova.compute.manager [req-311264bc-0920-48e0-880a-b9213402cd9e req-0bd14626-2020-43c8-99b7-44d9454db785 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] No waiting events found dispatching network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:41:27 user nova-compute[72184]: WARNING nova.compute.manager [req-311264bc-0920-48e0-880a-b9213402cd9e req-0bd14626-2020-43c8-99b7-44d9454db785 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received unexpected event network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 for instance with vm_state building and task_state spawning.
Aug 01 17:41:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:28 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:28 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-f3744568-2c60-444d-8bdf-5639c0ea94a7 req-e2b7f21a-43f3-445a-b027-19bf6fc380b7 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3744568-2c60-444d-8bdf-5639c0ea94a7 req-e2b7f21a-43f3-445a-b027-19bf6fc380b7 service nova] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3744568-2c60-444d-8bdf-5639c0ea94a7 req-e2b7f21a-43f3-445a-b027-19bf6fc380b7 service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-f3744568-2c60-444d-8bdf-5639c0ea94a7 req-e2b7f21a-43f3-445a-b027-19bf6fc380b7 service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [req-f3744568-2c60-444d-8bdf-5639c0ea94a7 req-e2b7f21a-43f3-445a-b027-19bf6fc380b7 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] No waiting events found dispatching network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:41:29 user nova-compute[72184]: WARNING nova.compute.manager [req-f3744568-2c60-444d-8bdf-5639c0ea94a7 req-e2b7f21a-43f3-445a-b027-19bf6fc380b7 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received unexpected event network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 for instance with vm_state building and task_state spawning.
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690911689.7736878, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => Resumed> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:41:29 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] VM Resumed (Lifecycle Event)
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Instance event wait completed in 0 seconds for  {{(pid=72184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Guest created on hypervisor {{(pid=72184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 17:41:29 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Instance spawned successfully.
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Found default for hw_cdrom_bus of ide {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Found default for hw_disk_bus of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Found default for hw_input_bus of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Found default for hw_pointer_model of None {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Found default for hw_video_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Found default for hw_vif_model of virtio {{(pid=72184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 17:41:29 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.virt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Emitting event <LifecycleEvent: 1690911689.7756646, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => Started> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:41:29 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] VM Started (Lifecycle Event)
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 17:41:29 user nova-compute[72184]: INFO nova.compute.manager [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 17:41:29 user nova-compute[72184]: INFO nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:41:29 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Skipping network cache update for instance because it is Building. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:30 user nova-compute[72184]: INFO nova.compute.manager [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Took 6.59 seconds to build instance.
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-9409c058-b513-4fcd-99eb-e300baf1f353 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.712s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:41:30 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:41:30 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=25.121509552001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:41:30 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:41:31 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:41:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:31 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:41:31 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:41:31 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:41:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:41:39 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:41:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:41:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:42:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:42:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:42:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:42:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:42:27 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:42:31 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:42:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:42:33 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:42:33 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.090221405029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:42:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:42:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:42:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:42:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:42:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:42:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:42:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:42:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:42:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:42:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:42:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:43:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:43:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:11 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-changed-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:43:14 user nova-compute[72184]: DEBUG nova.compute.manager [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Refreshing instance network info cache due to event network-changed-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089. {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 17:43:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:43:14 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:43:14 user nova-compute[72184]: DEBUG nova.network.neutron [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Refreshing network info cache for port 76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 17:43:15 user nova-compute[72184]: DEBUG nova.network.neutron [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated VIF entry in instance network info cache for port 76a3c74c-c5d1-46d8-b0e2-2b3ea7183089. {{(pid=72184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 17:43:15 user nova-compute[72184]: DEBUG nova.network.neutron [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:43:15 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-343f6189-9243-4b90-aca6-b5aa659cb602 req-91c18ec8-cbcf-493d-9073-33dc51430afa service nova] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:43:15 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:43:19 user nova-compute[72184]: INFO nova.compute.manager [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attaching volume 00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 to /dev/vdb
Aug 01 17:43:19 user nova-compute[72184]: DEBUG os_brick.utils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbd452-2528-4347-b3c1-d229fee37240]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f28f7-7280-4baf-bee3-95e54de716cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1b7ff-3e2e-4265-9adb-7d5d2a42d1b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b94c8-c717-4430-9053-801a4d758fa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:43:19 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:43:19 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[793a9763-5b81-4da2-b473-d6e74147d090]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG os_brick.utils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:43:19 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating existing volume attachment record: 65e4f59a-1edb-429d-80c9-a9014cfa06fb {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:43:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:25 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkfFiOyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:43:26 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:43:26 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:43:26 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de8c7d-0bc1-4e70-9b0d-a0ccda2861b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:43:26 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a783ac7-d25f-4ef7-addc-28d542fb5603]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1] added
Aug 01 17:43:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447e568-3bb3-4317-9627-650071c6342d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb22e2d-dc41-4c01-bd9a-71282e36ecc3]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkfFiOyP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkfFiOyP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8733c18d-1d89-4288-adbf-044102731b00]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XkfFiOyP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0e90a4-8a1b-49e2-870f-d7ab8531bc58]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c493a-119f-4c74-a832-385d859710b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:43:26 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:43:26 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:43:26 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:43:26 user nova-compute[72184]: 
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6173003-d6d3-4bc9-a9ad-6610ce92ca34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260]
Aug 01 17:43:26 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260] successful.
Aug 01 17:43:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2366b59a-ca49-4b61-b3fe-f3526c64446b]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7080421-4d12-4c66-805f-bc19c5b403a8]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 (non-flash)
Aug 01 17:43:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 (non-flash)
Aug 01 17:43:26 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb36f8e-2a93-4477-84b8-e231a97c2820]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:26 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkfFiOyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23763336630303736', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763336630303736', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:43:27 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:43:27 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:43:27 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:43:27 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:43:27 user nova-compute[72184]:   <serial>00c5d84e-7f0b-4bc2-9d9c-f647b74240c1</serial>
Aug 01 17:43:27 user nova-compute[72184]: </disk>
Aug 01 17:43:27 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:43:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:43:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:43:28 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No VIF found with MAC fa:16:3e:c3:97:d4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:43:28 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7dd3679c-e50b-4504-a4e6-82b933f1a56c tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.150s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:43:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:30 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 17:43:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:43:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:43:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=25.081172943115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:43:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:43:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:35 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:43:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:43:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:43:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:43:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:43:46 user nova-compute[72184]: INFO nova.compute.manager [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Detaching volume 00c5d84e-7f0b-4bc2-9d9c-f647b74240c1
Aug 01 17:43:46 user nova-compute[72184]: INFO nova.virt.block_device [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attempting to driver detach volume 00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 from mountpoint /dev/vdb
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Attempting to detach device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:43:46 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:43:46 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:43:46 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:43:46 user nova-compute[72184]:   <serial>00c5d84e-7f0b-4bc2-9d9c-f647b74240c1</serial>
Aug 01 17:43:46 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:43:46 user nova-compute[72184]: </disk>
Aug 01 17:43:46 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:43:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config.
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:43:46 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:43:46 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:43:46 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:43:46 user nova-compute[72184]:   <serial>00c5d84e-7f0b-4bc2-9d9c-f647b74240c1</serial>
Aug 01 17:43:46 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:43:46 user nova-compute[72184]: </disk>
Aug 01 17:43:46 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690911826.96584, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:43:46 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config.
Aug 01 17:43:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkfFiOyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:43:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:43:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:43:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0081f4c-661b-4ef6-a579-f1c816c50bd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b05b4c-37b6-444d-ab06-d027d6d24b29]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 (non-flash)
Aug 01 17:43:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 (non-flash)
Aug 01 17:43:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff8511630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2885e5c-4505-407c-8842-30c042f262a0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21648fc6-d8df-4b8c-98bb-1b8b0129061c]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dfc296-a1af-4958-a3a3-9bd4efbe41d9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76884e7e-85b8-46d1-ac88-1e4088f666b5]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908e5dc-97cb-439c-8c99-001cc91225fb]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f71ef-ebf5-4dce-8798-5f80b25bc63f]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260]
Aug 01 17:43:47 user nova-compute[72184]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1, portal: 172.16.0.220,3260] successful.
Aug 01 17:43:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c5d84e-7f0b-4bc2-9d9c-f647b74240c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac984301-706a-4f40-84ef-428954fb6c16]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== disconnect_volume: return (269ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:43:47 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:43:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7f5b048f-1cf3-4ff5-b83f-fb48f545b508 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.548s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:43:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:43:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:44:01 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:01 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:44:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:44:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:30 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:44:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:44:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.080307006835938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:44:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:44:33 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:44:33 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:44:33 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:44:33 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG nova.objects.instance [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:44:39 user nova-compute[72184]: INFO nova.compute.manager [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attaching volume 84ebb58f-666c-48dd-b21c-59e7a94ff3a8 to /dev/vdb
Aug 01 17:44:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4d1fd-65ec-4d41-8dba-c2f014bccd51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ba391-3bca-460c-ac7b-ff8dcb5ef791]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d745e578-2ca2-4732-835b-9ba99fd2179c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755b869-0a03-4e09-a541-168d1829d81e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:44:39 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:44:39 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13df5667-ad86-44f7-8744-fe7088498992]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG os_brick.utils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:44:39 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating existing volume attachment record: f877c5c1-4108-4f86-b812-8a9292df5f2e {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:44:40 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:41 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:44:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwFKHvWo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:44:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:44:46 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:44:46 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d7d95-2f58-433c-8e0c-7cc7a72e6854]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:44:46 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66ddd3-8ce8-433b-99f6-c8f9257195b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8] added
Aug 01 17:44:46 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcab572-6fd4-42cb-82a0-7dd256eb8777]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32ed76-4930-4921-9013-8f41f02584dc]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwFKHvWo {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwFKHvWo" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9872e69e-202b-480a-a859-3b898ceaed50]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwFKHvWo'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81affafd-8dc5-43d5-ad66-f468a1447e8d]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae3e2f-ec4f-4559-bad4-6819f79f5a09]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:44:47 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:44:47 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:44:47 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:44:47 user nova-compute[72184]: 
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b9eaa9-6bcb-4a1b-bf4d-1f9d71710f73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260]
Aug 01 17:44:47 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260] successful.
Aug 01 17:44:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e399f58d-93a6-4bad-a414-f8ad7fedc4f5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763b46f-7b94-4053-82f1-0ba430e67767]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 (non-flash)
Aug 01 17:44:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 (non-flash)
Aug 01 17:44:47 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94919518-72ed-4a5f-8bce-d084356d9ef2]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:44:47 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwFKHvWo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23336386130633764', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336386130633764', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG nova.objects.instance [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:44:48 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:44:48 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:44:48 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:44:48 user nova-compute[72184]:   <serial>84ebb58f-666c-48dd-b21c-59e7a94ff3a8</serial>
Aug 01 17:44:48 user nova-compute[72184]: </disk>
Aug 01 17:44:48 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No VIF found with MAC fa:16:3e:c3:97:d4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:44:48 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-deda96a3-5c7b-49a7-95fc-c78071174ea5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.013s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:44:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:44:50 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:44:51 user nova-compute[72184]: INFO nova.compute.manager [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Detaching volume 84ebb58f-666c-48dd-b21c-59e7a94ff3a8
Aug 01 17:44:51 user nova-compute[72184]: INFO nova.virt.block_device [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attempting to driver detach volume 84ebb58f-666c-48dd-b21c-59e7a94ff3a8 from mountpoint /dev/vdb
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Attempting to detach device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:44:51 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:44:51 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:44:51 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:44:51 user nova-compute[72184]:   <serial>84ebb58f-666c-48dd-b21c-59e7a94ff3a8</serial>
Aug 01 17:44:51 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:44:51 user nova-compute[72184]: </disk>
Aug 01 17:44:51 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:44:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config.
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:44:51 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:44:51 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:44:51 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:44:51 user nova-compute[72184]:   <serial>84ebb58f-666c-48dd-b21c-59e7a94ff3a8</serial>
Aug 01 17:44:51 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:44:51 user nova-compute[72184]: </disk>
Aug 01 17:44:51 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690911891.5175793, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:44:51 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config.
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwFKHvWo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:44:51 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8badf6-3959-4e86-a2ad-94ba020a3f20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7bec24-b332-4dc0-b654-3cb5bd5926ca]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 (non-flash)
Aug 01 17:44:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 (non-flash)
Aug 01 17:44:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301830cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54b96d-2860-47ef-b907-83e388d96616]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1086f4cd-632f-4f5a-b292-3110cc430074]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c60721-ed5d-4e74-aac6-f78a3f722c29]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceb4258-01ab-4c4c-840b-664cfebc9f11]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e760cd-b56a-4399-a632-3e6afd09d415]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66727407-82b1-49cf-b41d-2ca418c22e41]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260]
Aug 01 17:44:51 user nova-compute[72184]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8, portal: 172.16.0.220,3260] successful.
Aug 01 17:44:51 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ebb58f-666c-48dd-b21c-59e7a94ff3a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73dc5a7-128e-4fcd-bf8d-09128c87b161]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== disconnect_volume: return (299ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:44:51 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:44:52 user nova-compute[72184]: DEBUG nova.objects.instance [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:44:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-043b75d7-88f1-4001-ad66-582e29fa6346 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:44:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:44:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:45:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:45:29 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:45:32 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.079273223876953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:45:32 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:45:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:45:34 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:45:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:45:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:45:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:45:45 user nova-compute[72184]: INFO nova.compute.manager [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attaching volume c6167b8d-9229-4456-84c6-9979c0373fc5 to /dev/vdb
Aug 01 17:45:45 user nova-compute[72184]: DEBUG os_brick.utils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4c737-c3df-4162-8707-440130e53bc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc919f7a-a427-41dc-99d1-9685c9ae0215]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f85046-baab-4c31-b5ec-ec9990a7d652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c6d181-b4e7-4f3e-b20d-538edd431d8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:45:45 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:45:45 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37622937-c24c-4a92-9e17-c2dad7161075]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG os_brick.utils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:45:45 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating existing volume attachment record: b70541e9-5096-4cdc-9b17-f604b6cc47ae {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:45:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:47 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:45:50 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIQqKsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:45:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:45:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:45:52 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e8b01-a677-4e48-873f-2222fb59d26c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:45:52 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737a5fb-173f-48d2-b811-efe5ca68baab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5] added
Aug 01 17:45:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c97ca9-165e-4582-b26c-f5a5749c0ec8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10985654-1790-4a11-9ff8-cf91d89eedf8]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIQqKsjS {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIQqKsjS" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[441d1b9b-bec5-4765-a687-22cafe1cd3e7]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIQqKsjS'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a6eae-7100-4ad4-b6d9-2ab803f21e3e]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a9b751-d17e-4542-8e07-cd0fc5128278]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:45:52 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:45:52 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:45:52 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:45:52 user nova-compute[72184]: 
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1262f0-a673-4bf2-ab67-a9ce32060df5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260]
Aug 01 17:45:52 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260] successful.
Aug 01 17:45:52 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09726213-a19f-4abe-a628-3e0ef7a0e0d4]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f73b78-1fee-479a-8ff3-a61be42b72bc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 (non-flash)
Aug 01 17:45:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 (non-flash)
Aug 01 17:45:53 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22ad4f9-843b-481b-bafd-ad42f66e70d1]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:53 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIQqKsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23936386532323434', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936386532323434', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG nova.objects.instance [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:45:54 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:45:54 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:45:54 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:45:54 user nova-compute[72184]:   <serial>c6167b8d-9229-4456-84c6-9979c0373fc5</serial>
Aug 01 17:45:54 user nova-compute[72184]: </disk>
Aug 01 17:45:54 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No VIF found with MAC fa:16:3e:c3:97:d4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:45:54 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-e3655cbe-134f-4484-a278-167968109022 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.065s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:45:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:45:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:45:56 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:45:56 user nova-compute[72184]: INFO nova.compute.manager [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Detaching volume c6167b8d-9229-4456-84c6-9979c0373fc5
Aug 01 17:45:56 user nova-compute[72184]: INFO nova.virt.block_device [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attempting to driver detach volume c6167b8d-9229-4456-84c6-9979c0373fc5 from mountpoint /dev/vdb
Aug 01 17:45:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Attempting to detach device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:45:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:45:56 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:45:56 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:45:56 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:45:56 user nova-compute[72184]:   <serial>c6167b8d-9229-4456-84c6-9979c0373fc5</serial>
Aug 01 17:45:56 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:45:56 user nova-compute[72184]: </disk>
Aug 01 17:45:56 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:45:56 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config.
Aug 01 17:45:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:45:56 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:45:56 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:45:56 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:45:56 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:45:56 user nova-compute[72184]:   <serial>c6167b8d-9229-4456-84c6-9979c0373fc5</serial>
Aug 01 17:45:56 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:45:56 user nova-compute[72184]: </disk>
Aug 01 17:45:56 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690911957.398956, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:45:57 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config.
Aug 01 17:45:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIQqKsjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:45:57 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da4c210-8c6e-4de1-9741-4d2914c17a62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94c62d5-2edc-4487-afc3-3dacce937ef2]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 (non-flash)
Aug 01 17:45:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 (non-flash)
Aug 01 17:45:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ff867da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18571b5-e1c1-4b61-8abc-f47a637d7732]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f07a3c-d91f-4851-b9bf-f0173ed513eb]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae7ded9-c018-4cf3-8cf4-b1ced8ce8816]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[485eb0b3-20da-4f44-a6f4-ca13780c052d]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bd50f6-8693-4115-a707-c4e6b758f8e9]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f50393-4c9b-42c2-bd44-ba38adbc5b6c]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260]
Aug 01 17:45:57 user nova-compute[72184]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5, portal: 172.16.0.220,3260] successful.
Aug 01 17:45:57 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6167b8d-9229-4456-84c6-9979c0373fc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a793b-9c25-42d6-bffb-b5ae7726ffb5]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== disconnect_volume: return (279ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:45:57 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:45:58 user nova-compute[72184]: DEBUG nova.objects.instance [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:45:58 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-7e8c9975-bc0e-4933-8bfa-7d5826536f8e tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:46:00 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:46:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:34 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:46:34 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:46:34 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.078277587890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:46:34 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:46:35 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:46:35 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:46:35 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:46:35 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:46:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:42 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:42 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:46:45 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:48 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:49 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG nova.objects.instance [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:46:51 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:46:52 user nova-compute[72184]: INFO nova.compute.manager [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attaching volume fbe8d3e6-485d-4a55-a157-a5192cdce4c7 to /dev/vdb
Aug 01 17:46:52 user nova-compute[72184]: DEBUG os_brick.utils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5046898f-4141-4f34-9b1b-48a0f1a0af8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:57ab92f352bb\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64569bca-7ca6-4bdb-9039-9a868345315e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0540fc-7021-4ace-aea3-870b3600925a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc14c83-7cf4-415e-a251-20ad733b4aca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Running cmd (subprocess): nvme version {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] nvme not present on system {{(pid=72184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 17:46:52 user nova-compute[72184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 17:46:52 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c417c-bd14-422e-97db-115a815743cb]: (4, '') {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.lightos [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] LIGHTOS: no hostnqn found. {{(pid=72184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG os_brick.utils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:57ab92f352bb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:46:52 user nova-compute[72184]: DEBUG nova.virt.block_device [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating existing volume attachment record: 0e913b66-c465-471a-932e-fde8740aef2d {{(pid=72184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 17:46:55 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Calling os-brick to attach iSCSI Volume {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHWoipyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:46:59 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:46:59 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:46:59 user nova-compute[72184]: INFO os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e6469-1d76-4d02-8dfe-088e069c9682]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 17:46:59 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6675171-2785-441c-b935-ef4cc0fcd2fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7] added\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7] added
Aug 01 17:46:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9764129-db9f-481f-a2a8-1bbd4826effa]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed0df8-5017-4400-a7b0-7cb9f47509e2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHWoipyd {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHWoipyd" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4676d024-cdef-4de7-bbf5-d6c41a302858]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHWoipyd'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6827f5-9eb4-4601-896c-c8ec4539a424]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88d9ac-aaf4-47ef-83e2-8a94b7413b89]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:46:59 user nova-compute[72184]:  {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 17:46:59 user nova-compute[72184]:  {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:46:59 user nova-compute[72184]: WARNING os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 17:46:59 user nova-compute[72184]: 
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --login {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dadf54-b0f8-4459-9e18-efb45cecf0f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260]
Aug 01 17:46:59 user nova-compute[72184]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260] successful.
Aug 01 17:46:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dac93cf-437c-4702-82b4-565622a6c876]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888fe9d-a939-4629-b1cc-8de4c3e76641]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 (non-flash)
Aug 01 17:46:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 (non-flash)
Aug 01 17:46:59 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to 172.16.0.220:3260 {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5feaf1-1e73-42ce-a167-39de18608810]: (4, ('- - 0', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 17:46:59 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHWoipyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23232366464613139', 'path': '/dev/sdb'} {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232366464613139', 'path': '/dev/sdb'} {{(pid=72184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG nova.objects.instance [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 17:47:00 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:47:00 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:47:00 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:47:00 user nova-compute[72184]:   <serial>fbe8d3e6-485d-4a55-a157-a5192cdce4c7</serial>
Aug 01 17:47:00 user nova-compute[72184]: </disk>
Aug 01 17:47:00 user nova-compute[72184]:  {{(pid=72184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 17:47:00 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] No VIF found with MAC fa:16:3e:c3:97:d4, not building metadata {{(pid=72184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 17:47:01 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-14896cc6-75bc-4f82-ab4d-75f17df4c9f5 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.054s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:47:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:47:03 user nova-compute[72184]: INFO nova.compute.manager [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Detaching volume fbe8d3e6-485d-4a55-a157-a5192cdce4c7
Aug 01 17:47:03 user nova-compute[72184]: INFO nova.virt.block_device [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Attempting to driver detach volume fbe8d3e6-485d-4a55-a157-a5192cdce4c7 from mountpoint /dev/vdb
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Attempting to detach device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config. {{(pid=72184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:47:03 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:47:03 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:47:03 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:47:03 user nova-compute[72184]:   <serial>fbe8d3e6-485d-4a55-a157-a5192cdce4c7</serial>
Aug 01 17:47:03 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:47:03 user nova-compute[72184]: </disk>
Aug 01 17:47:03 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:47:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the persistent domain config.
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config. {{(pid=72184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.guest [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 17:47:03 user nova-compute[72184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 17:47:03 user nova-compute[72184]:   <source dev="/dev/sdb"/>
Aug 01 17:47:03 user nova-compute[72184]:   <target dev="vdb" bus="virtio"/>
Aug 01 17:47:03 user nova-compute[72184]:   <serial>fbe8d3e6-485d-4a55-a157-a5192cdce4c7</serial>
Aug 01 17:47:03 user nova-compute[72184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 17:47:03 user nova-compute[72184]: </disk>
Aug 01 17:47:03 user nova-compute[72184]:  {{(pid=72184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-90d56ec6-d63b-4377-bd3e-b3e98c7b70d8 None None] Received event <DeviceRemovedEvent: 1690912023.8630762, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.driver [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 17:47:03 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully detached device vdb from instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 from the live domain config.
Aug 01 17:47:03 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] calling os-brick to detach iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30279aa410>, {'target_iqns': ['iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHWoipyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 17:47:03 user nova-compute[72184]: WARNING os_brick.initiator.connectors.base [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7', 0)] {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f591e-4ba4-4fbb-8d7e-921c4f9699dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3856b2-2b2d-4096-9444-ee25a0cc961e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 (non-flash)\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 (non-flash)
Aug 01 17:47:03 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 (non-flash)
Aug 01 17:47:03 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f301844add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7'): ({'sdb'}, set())}) {{(pid=72184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Removing single pathed devices sdb {{(pid=72184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6666a9-e323-4940-9701-8fae91f3dbd1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef470f-9caf-42bf-ae10-9163c361c6f1]: (4, ('ok\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Flushing IO for device /dev/sdb {{(pid=72184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4bdc7-6356-4055-9f16-303d0394e53f]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 17:47:03 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aceb9dd-029a-41bb-9365-18fdf58de132]: (4, ('1', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.linuxscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] SCSI volumes sdb have been removed. {{(pid=72184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7')] {{(pid=72184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[215beac9-7647-439e-a355-c5294a923bc2]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --logout {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c93f2a-0f25-4987-a1f4-a61ba5503f7c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260]
Aug 01 17:47:04 user nova-compute[72184]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7, portal: 172.16.0.220,3260] successful.
Aug 01 17:47:04 user nova-compute[72184]:  stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op delete {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbe8d3e6-485d-4a55-a157-a5192cdce4c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9297153-7b26-400b-bd96-1bd2fec00e50]: (4, ('', '')) {{(pid=83397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.base [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] <== disconnect_volume: return (275ms) None {{(pid=72184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 17:47:04 user nova-compute[72184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Disconnected iSCSI Volume {{(pid=72184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 17:47:05 user nova-compute[72184]: DEBUG nova.objects.instance [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'flavor' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:47:05 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5d3-5f20-450a-9aed-27df63ec2d13 tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.905s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:47:05 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:47:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:47:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:47:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:47:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:26 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:31 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:31 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:33 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:35 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.processutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 17:47:36 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:47:36 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.077239990234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:47:36 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:47:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:47:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquired lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Forcefully refreshing network info cache for instance {{(pid=72184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG nova.objects.instance [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lazy-loading 'info_cache' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG nova.network.neutron [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [{"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Releasing lock "refresh_cache-03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" {{(pid=72184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updated the network info_cache for instance {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 17:47:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:41 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:43 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:43 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:47:46 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:47:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:48 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:47:51 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:47:56 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:01 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:06 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:11 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:17 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:21 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:21 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:21 user nova-compute[72184]: INFO nova.compute.manager [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Terminating instance
Aug 01 17:48:21 user nova-compute[72184]: DEBUG nova.compute.manager [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Start destroying the instance on the hypervisor. {{(pid=72184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-94fb7470-c45e-4fd0-8f3f-2a9f2cd4ecb6 req-a0f946bf-f75b-48bb-bad0-3d7a616e52aa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-vif-unplugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-94fb7470-c45e-4fd0-8f3f-2a9f2cd4ecb6 req-a0f946bf-f75b-48bb-bad0-3d7a616e52aa service nova] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-94fb7470-c45e-4fd0-8f3f-2a9f2cd4ecb6 req-a0f946bf-f75b-48bb-bad0-3d7a616e52aa service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-94fb7470-c45e-4fd0-8f3f-2a9f2cd4ecb6 req-a0f946bf-f75b-48bb-bad0-3d7a616e52aa service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-94fb7470-c45e-4fd0-8f3f-2a9f2cd4ecb6 req-a0f946bf-f75b-48bb-bad0-3d7a616e52aa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] No waiting events found dispatching network-vif-unplugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.compute.manager [req-94fb7470-c45e-4fd0-8f3f-2a9f2cd4ecb6 req-a0f946bf-f75b-48bb-bad0-3d7a616e52aa service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-vif-unplugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 for instance with task_state deleting. {{(pid=72184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: INFO nova.virt.libvirt.driver [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Instance destroyed successfully.
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.objects.instance [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lazy-loading 'resources' on Instance uuid 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 {{(pid=72184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.virt.libvirt.vif [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T17:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1105224371',display_name='tempest-SnapshotDataIntegrityTests-server-1105224371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1105224371',id=52,image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTARVG+O82ti1bc0OrrD5abpA3UXMkd3WL/M+9vANpNGYXOxIjF3JZAR1iLa5Jokct620L1Tz0V5M3jdNW7FRXePE91VPBWfrQNa+s8cH3ByI0HUZnH3g30mbR1zVkhYw==',key_name='tempest-keypair-765723039',keypairs=<?>,launch_index=0,launched_at=2023-08-01T17:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a0be8a37e7148c88948ac1669389a51',ramdisk_id='',reservation_id='r-z0jp6v14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='445427d2-2c17-4b94-ba10-8b1151983d7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-633366244',owner_user_name='tempest-SnapshotDataIntegrityTests-633366244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T17:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0594bd534aff4934bd10c25d68f00e62',uuid=03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Converting VIF {"id": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "address": "fa:16:3e:c3:97:d4", "network": {"id": "282711cc-c9f5-428c-95b2-35586e801c5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030057167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a0be8a37e7148c88948ac1669389a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a3c74c-c5", "ovs_interfaceid": "76a3c74c-c5d1-46d8-b0e2-2b3ea7183089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.network.os_vif_util [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5') {{(pid=72184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG os_vif [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5') {{(pid=72184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76a3c74c-c5, bridge=br-int, if_exists=True) {{(pid=72184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:22 user nova-compute[72184]: INFO os_vif [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:97:d4,bridge_name='br-int',has_traffic_filtering=True,id=76a3c74c-c5d1-46d8-b0e2-2b3ea7183089,network=Network(282711cc-c9f5-428c-95b2-35586e801c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a3c74c-c5')
Aug 01 17:48:22 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Deleting instance files /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9_del
Aug 01 17:48:22 user nova-compute[72184]: INFO nova.virt.libvirt.driver [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Deletion of /opt/stack/data/nova/instances/03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9_del complete
Aug 01 17:48:22 user nova-compute[72184]: INFO nova.compute.manager [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 17:48:22 user nova-compute[72184]: DEBUG oslo.service.loopingcall [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.compute.manager [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Deallocating network for instance {{(pid=72184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 17:48:22 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] deallocate_for_instance() {{(pid=72184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 17:48:23 user nova-compute[72184]: DEBUG nova.network.neutron [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Updating instance_info_cache with network_info: [] {{(pid=72184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 17:48:24 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Took 1.11 seconds to deallocate network for instance.
Aug 01 17:48:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-bee0c793-3edc-4aff-a497-b08672956794 req-4d5a94fd-c0a3-447c-b871-4a965ee86d72 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-vif-deleted-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:24 user nova-compute[72184]: INFO nova.scheduler.client.report [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Deleted allocations for instance 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-59fc1657-c762-422b-a1f7-d8d00c8e7bbf tempest-SnapshotDataIntegrityTests-633366244 tempest-SnapshotDataIntegrityTests-633366244-project-member] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-7acbd22b-7ffb-4f32-8992-c89cedf2daa4 req-f2bf94ee-c74e-483e-af35-f5582a518bf9 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received event network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7acbd22b-7ffb-4f32-8992-c89cedf2daa4 req-f2bf94ee-c74e-483e-af35-f5582a518bf9 service nova] Acquiring lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7acbd22b-7ffb-4f32-8992-c89cedf2daa4 req-f2bf94ee-c74e-483e-af35-f5582a518bf9 service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [req-7acbd22b-7ffb-4f32-8992-c89cedf2daa4 req-f2bf94ee-c74e-483e-af35-f5582a518bf9 service nova] Lock "03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:24 user nova-compute[72184]: DEBUG nova.compute.manager [req-7acbd22b-7ffb-4f32-8992-c89cedf2daa4 req-f2bf94ee-c74e-483e-af35-f5582a518bf9 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] No waiting events found dispatching network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 {{(pid=72184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 17:48:24 user nova-compute[72184]: WARNING nova.compute.manager [req-7acbd22b-7ffb-4f32-8992-c89cedf2daa4 req-f2bf94ee-c74e-483e-af35-f5582a518bf9 service nova] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Received unexpected event network-vif-plugged-76a3c74c-c5d1-46d8-b0e2-2b3ea7183089 for instance with vm_state deleted and task_state None.
Aug 01 17:48:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:34 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:48:36 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690912102.7705636, 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9 => Stopped> {{(pid=72184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 17:48:37 user nova-compute[72184]: INFO nova.compute.manager [-] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] VM Stopped (Lifecycle Event)
Aug 01 17:48:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-e822f130-5aac-4751-911b-25b2e148f72e None None] [instance: 03ca2a4b-e3b4-4e3e-9cf6-8d1c9d334fa9] Checking state {{(pid=72184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:48:38 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:48:38 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.104305267333984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:48:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:48:41 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:44 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 17:48:45 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] There are 0 instances to clean {{(pid=72184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 17:48:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:46 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 17:48:46 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:47 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:47 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:51 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:52 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:54 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:48:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:48:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:48:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:48:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:48:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:48:57 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:02 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:03 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:03 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 17:49:07 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:49:12 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:49:14 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:16 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:17 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:20 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:22 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:26 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:49:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:49:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:49:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:49:27 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:32 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:36 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Starting heal instance info cache {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 17:49:37 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Rebuilding the list of instances to heal {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.manager [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Didn't find any instances for network info cache update. {{(pid=72184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Auditing locally available compute resources for user (node: user) {{(pid=72184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 17:49:38 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:49:38 user nova-compute[72184]: WARNING nova.virt.libvirt.driver [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=25.099956512451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing inventories for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating ProviderTree inventory for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Updating inventory in ProviderTree for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing aggregate associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, aggregates: None {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Refreshing trait associations for resource provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=72184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.provider_tree [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed in ProviderTree for provider: 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 {{(pid=72184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.scheduler.client.report [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Inventory has not changed for provider 5cf41cf1-0c69-41fb-ba03-7df2d0ee3fc1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG nova.compute.resource_tracker [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Compute_service record updated for user:user {{(pid=72184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 17:49:38 user nova-compute[72184]: DEBUG oslo_concurrency.lockutils [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=72184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 17:49:40 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:40 user nova-compute[72184]: DEBUG oslo_service.periodic_task [None req-92f2d587-392e-4ada-afb3-47024bcbe06c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 17:49:42 user nova-compute[72184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}